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Abstract 

An Interference Channel with Generalized Feedback (IFC-GF) is a model 
for a wireless network where several source-destination pairs compete for 
the same channel resources, and where the sources have the ability to sense 
the current channel activity. The signal overheard from the channel provides 
information about the activity of the other users, and thus furnishes the basis 
for cooperation. In this two-part paper we study achievable strategies and 
outer bounds for a general IFC-GF with two source-destination pairs. We 
then evaluate the proposed regions for the Gaussian channel. 

Part I: Achievable Region. We propose that the generalized feedback is 
used to gain knowledge about the message sent by the other user and then 
exploited in two ways: (a) to relay the messages that can be decoded at both 
destinations-thus realizing the gains of beam-forming of a distributed multi- 
antenna system-and (b) to hide the messages that can not be decoded at the 
non-intended destination-thus leveraging the interference "pre-cancellation" 
property of dirty-paper-type coding. We show that our achievable region 
generalizes several known achievable regions for IFC-GF and that it reduces 
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to known achievable regions for some of the channels subsumed by the IFC- 
GF model. 

Part II: Outer Bounds. We strengthen the cut-set bound in two ways. We 
first derive two new sum-rate bounds by using Sato's "receiver cooperation 
with worst possible correlation" idea: we enhance the channel by letting 
also the destinations cooperate, but-as in broadcast channels-we choose the 
correlation among the destination outputs that gives the tightest bound. We 
show that several bounds known in the literature-each derived with an ad- 
hoc technique-are in fact examples of this "receiver cooperation with worst 
possible correlation" idea. We then derive a sum-rate outer bound for a 
class of channels with a special interference structure. This class includes 
the Gaussian channel. When evaluating the proposed outer bound for the 
Gaussian channel, we observe that our bound is the tightest among existing 
bounds for certain range of parameters. 



1 Introduction 

The practical bottleneck of today's cornmunication networks is interference. The 
solution of commercial available networks is thus to avoid interference through 
division of the resources, i.e., time, spectrum, space and waveforms, among the 
competing users. This approach is appealing in practice because it results in a 
simple network architecture. It might also appear a good solution in theory since 
it is well known that in SISO (Single Input Single Output) uplink and downlink 
wireless channels with perfect centralized channel state information, it is sum-rate 
optimal to allocate all the available channel resources to the user who experiences 
the instantaneous highest channel gain (39j. Perfect orthogonalization of the users 
is however not possible in practice. The practical approach to deal with residual 
interference is to treat it as noise, thus completely neglecting its structure. When- 
ever interference is treated as noise, the system becomes rate-limited even when 
there is no power limitation at the transmitters. This negative view of interference 
was further reinforced by scaling law results of the early 00's that showed that the 
total rate of the wireless network with K users only scales as vK, thus yielding 
a vanishing per-user rate as the network grows |34j. It was also conjectured that, 
even with cooperation, the multiplexing gain of an interference network would 
be one irrespectively of the number of users, thus again the per-user rate would 



vanish as the number of users in the network grows [22\. 

On the other hand, it has been known since the mid 70's that there exist chan- 
nels where interference does not reduce capacity [j4j,|4T]| . These channels are said 
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to have "very strong interference", that is, the power imbalance between the use- 
ful signal and the interfering signal at a receiver is so large that a given user can 
first decode the interfering signal by treating its own signal as noise, then strip 
the (now known) interference from its received signal, thus effectively having an 
interference-free channel. This early example showed that interference should not 
be treated as noise in general-in fact, as opposed to noise, it has a structure that 
can be exploited-and that power imbalance must be leveraged upon in the system 
design. With these observations in mind, much progress has been made recently 
in understanding the ultimate performance limits of interference networks [JTJ 14 1 . 
In the authors' opinion, the major recent result has been to show that in an inter- 
fering network with K users the sum-rate capacity scales as y log(l+SNR). This 
implies that each user can get half the rate it would get if it were alone on the net- 
work, no matter how how many users are present in the network. The technique 
that achieves this capacity scaling is referred to as interference alignment [[TJ. Un- 
der the interference alignment paradigm, users do not avoid interference. Instead, 
they make sure that the interference they collectively generate at a given receiver 
is neatly confined in a specific signal subspace. This leaves the complement of 
this subspace interference free. With interference alignment, a per-user rate of 
\ log(l + SNR) can be achieved irrespectively of the number of users. 

In this work we consider networks of full-duplex nodes, where several source- 
destination pairs share the same channel. The channel is assumed to be static so 
that every node in the network has perfect knowledge of the channel sate. Exten- 
sions to networks of half-duplex nodes and/or of time-varying channels, such as 
fading channels, are planned as part of future work. We focus on the case where 
all nodes can listen to the channel activity. In particular, we are interested in the 
case where the sources can "overhear" what the other sources are sending, as in 
relay networks. The key observation is that interference due to simultaneous com- 
munications effectively spreads "common information" around the network. This 
information provides the basis for cooperation among otherwise uncoordinated 
nodes. 



1.1 Related Works 

The signal a node can "overhear" form the channel is a form of feedback. To 
distinguish this feedback information from the classical Shannon output feedback, 
Willems referred to it as Generalized Feedback (GF) [48]. GF encompasses a wide 
range of possible situations, examples are: noisy output feedback (with the non- 
feedback case and the output feedback case at the two extremes); conferencing 
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encoders (where there are separate noise-free and interference-free links between 
the sources, each of finite capacity); the case of GF with independent noises, 
sometimes referred to as user cooperation. The motivation to study GF comes 
from the work of Gaarder and Wolf |49j who showed that output feedback can 
enlarge the capacity region of a MAC channel. Here, we consider the general 
case of GF Hence our results can be specialized to all the above situations. Our 
approach-especially when in dealing with outer bounds-shows that all the above 
cases can be dealt with in great generality. One of our contributions is to show a 
unifying way of deriving some of the results available in the literature. 



MAC-GF In |48j, an achievable region for the MAC-GF (Multiple Access Chan- 
nels with Generalized Feedback) was derived. The two main ingredients are reg- 
ular block-Markov superposition coding and backward decoding. Block-Markov 
coding, also known as Decode-and-Forward from the work by Cover and A. El 
Gamal [ fTOj in the context of relay channels, works as follows. Communication 
proceeds over a frame of N > 1 slots. The source splits the message to be trans- 
mitted in a given slot into two parts. The first part is decoded by the destination, 
but treated as noise by the relay. The second part is decoded also by the relay, that 
then retransmits it to the destination in the next slot. Because the source knows 
what the relay is going to send in the next slot, it can "coordinate" with the re- 
lay. In each slot, the destination receives the superposition of the new information 
(sent by the source) and the repetition of part of the old information (forwarded 
by the relay). The receiver waits until the whole frame has been received. Then 
appropriately combines the information sent in consecutive slots to recover all the 
transmitted messages. 

Willems's coding scheme for Gaussian channels was popularized by Sendonaris 
et al. 1 42 1 under the name of user cooperation diversity in the context of cellular 
networks. In [ |42| it was showed that cooperation between users achieves collec- 
tively higher data rates or, alternatively, allows to reach the same data rates for 
less transmission power. Since the publication of [42], the interest in coopera- 
tive strategies has not ceased to increase (we do not attempt here to review all the 
extensions of [ |42| for sake of space). 

Although the MAC-GF has proved to be instrumental in understanding the 
potential of user cooperation in networks, it is not as well suited for ad-hoc/peer- 
to-peer networks, where the absence of coordination among users exacerbate the 
problem of interference. Host-Madsen pT| first extended the Gaussian MAC-GF 
model of [|42] to the case of Gaussian IFC-GF. Before dwelling into the literature 
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of IFC-GF, we briefly revise the known results on IFC without feedback. 



IFC without feedback The capacity region of a general IFC without feedback 
is still unknown. The largest achievable region is due to Han and Kobayashi [[19j, 
whose "compact" expression appeared ||6). In IFCs without feedback, communi- 
cations is as follows. Each transmitter splits its message in two parts: a common 
message and a private message. The two messages are superimposed and sent 
through the channel. Each receiver decodes its intended common and private 
messages, as well as the common message of the other user, by treating the other 
user's private message as noise. The goal of this joint decoding is to reduce the 
interference level. The idea of information splitting was first proposed by Car- 
leial (5J, to whom many other early results on IFCs are due. 

The Han-Kobayashi scheme is optimal in strong interference I^IMII? ■ ^1 1> 



and it is shown to be sum-rate optimal in mixed interference p3||46] , in very-weak 
interference p3|[47|[52|, for the Z-IFC [|40| (where only one receiver experiences 



interference), and for certain semi-deterministic channels JT5J|44J. Moreover, a 
simple rate- splitting choice in the Han-Kobayashi scheme is optimal to within 



1 bit for the Gaussian IFC [ 14 1 



In this work, we propose an achievable region that combines the idea of infor- 
mation splitting with that of Block Markov Coding & Backward Decoding. 

Early work on IFC-GF Host-Madsen pT[ first studied inner and outer bounds 
for the sum-rate of IFC with both source and destination cooperation. He showed 
that in IFC networks with two SISO source-destination pairs, where the chan- 
nel gains stay constant and the user' powers increase, the multiplexing gain is 
one, with both types of cooperation (instead of two, which would be the case if 
cooperation were equivalent to a 2x2 virtual MIMO channel). In [21], several 
achievable strategies are proposed for the Gaussian channel only, each relatively 
simple and tailored to a specific sets of channel gains. 



The work in [21 1 was extended to a general DMC (Discrete Memory less Chan- 



nel) IFC-GF in 1)2,24 45 1. These works proposed to add one extra level of infor- 



mation splitting to the original Han-Kobayashi scheme. 



IFC-GF: Cooperation on sending the common information In [ |45| , we pro- 
posed to further split the common message in two parts: one part (referred to as 
non-cooperative common information) is as in the Han-Kobayashi scheme, while 
the other part (referred to as cooperative common information) is decoded at the 
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other source too. The sources use a block-Markov encoding scheme where in 
a given slot they "retransmit" the cooperative common information learnt in the 
previous slot. This cooperation strategy aims to realize the beam-forming gain of 
a distributed MISO channel. 



A scheme similar to ours in [45] was independently proposed by Jiang et al. 
in p4| for the IFC with output feedback (i.e., not for a general GF setting). The 
difference lies in the way the cooperative common information is dealt with, both 
at the sources and at the destination. It is not clear which scheme achieves the 
largest achievable region (we will elaborate more on this point later on). 

Recently, Prabhakaran and Viswanath p5| developed an outer bound for the 



sum-rate of a symmetric Gaussian IFC-GF with independent noises, inspired by 



the semi-deterministc model of [44 1; they showed that their upperbound is achiev- 
able within a constant gap of 18 bits when the cooperation link gains are smaller 
than the direct link gains; their achievable strategy is a simple form of our region 
ing5). 

Cooperation on sending the common information is the essence of the first 
achievable region presented in Part I this work. 

IFC-GF: Cooperation on sending the private information In [2], the authors 
proposed to further split the private message in two parts: one part (which we 
shall refer to as non-cooperative private information) is as in the Han-Kobayashi 
scheme, while the other part (which we shall refer to as cooperative private in- 
formation) is decoded at the other source too. The sources use a block-Markov 
encoding scheme where in a given slot they "hide" the cooperative private in- 
formation learnt in the previous slot to their intended receiver by using Gelfand- 
Pinsker coding [|7j[T8j. An approach similar to [j2j (commonly referred to as "dirty 



paper coding" for Gaussian channels |7J) was already used in [21 1 to character- 
ize the high SNR sum-rate capacity of the Gaussian IFC-GF. In (2TJ, it was first 
noted that in the high SNR regime, nulling the interference (i.e., an ancestor of 
interference alignment) is asymptotically optimal. 

In [[3j, the ideas of [2] and of [ |45| were merged into a scheme where both 
the common and the private information are split into two parts. In [53] we pro- 
posed a different (more structured) coding strategy than in [[3j. As opposed to [|3j, 
in [ [53| we did not use independent Gelfand-Pinsker binning codes to pre-cancel 
the effect of the cooperative private information. Instead, we proposed to super- 
impose several Gelfand-Pinsker binning codes (inspired by the work in [ 30] for 
cognitive IFCs) in such a way that the different binning stages are performed se- 
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quentially and conditionally on the previous ones. In addition, we also added a 
binning step similar to Marton's achievable scheme for a general two-user broad- 
cast channel [32]. The broadcast-type binning step is possible in IFC-GFs because 
each encoder knows part of the message sent by the other encoder, i.e., each trans- 



mitter is partially cognitive in the sense of [30]. A simple form of [53]'s region 
was shown to be optimal within a constant gap of 18 bits for the symmetric Gaus- 
sian IFC-GF with independent noises when the cooperation link gains are larger 
than the direct link gains. 

The second achievable region presented in Part I of this work is a further 
enhancement of $53]/. 

IFC with degraded output feedback The GF setting covers a wide range of 
situations. In particular, the case of degraded output feedback has been studied 
by a number of groups. Degraded output feedback refers to the case where the 
GF signal received at a source is a noisier version of the signal received at the 
intended destination. When the variance of the extra noise on the GF signal is 



zero, we have the so called output feedback. Kramer in p5|[26| developed inner 
and outer bounds for the Gaussian channel with output feedback. Kramer and 
Gastpar [17], and more recently Tandon and Ulukus p7| |, derived an outer bound 
for the degraded output feedback case based on the dependance balance idea of 
Hekstra and Willems pO) . Suh and Tse J43| developed a novel outer bound for 
the Gaussian case with output feedback and showed it to be achievable to within 
1 .7 bits. In [ |43~J it was also shown that the achievable region of p4| is optimal for 
the case of deterministic channels with output feedback. 

As mentioned earlier, our achievable region is applicable to all forms of GF, 
thus also to the case of output feedback. 

Other channel models The IFC-GF reduces to some well known channel mod- 
els. Under certain conditions, it reduces to a Broadcast Channel (BC) p2l, or 



to MAC-GF f4§, or to a Relay Channel (RC) [10], or to a Cognitive IFC (C- 
IFC) (38). 

We shall also describe how our results encompass known results for these 
channels. 
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1.2 Summary of Contributions 



In this first part of the paper we present our achievable regions. We first present a 
region where cooperation is on sending the common information only. The pur- 
pose is to highlight the key elements of our encoding and decoding scheme before 
proceeding to describe our more general scheme, where the sources cooperate 
in sending both the common and the private messages. Our contributions are as 
follows. 

Cooperation to send the common information only: 

1. We propose a structured way of superimposing the different codebooks 
that greatly simplifies the error analysis. Our codebook "nesting" is such 
that the "cloud center" codebook is the one all terminals will be decoding, 
i.e., the cooperative common codebook, to which we superimpose the non- 
cooperative common codebook (to be decoded by the two destinations but 
not by the other source) and finally we superimpose the non-cooperative 
private codebook (to be decoded at the intended receiver only). We shall 
see that although the destinations have to decode five messages, only 5 out 
of the possible 2 5 — 1 = 31 error events matter. 

2. We then perform Fourier Motzking elimination to obtain a region with only 
five types of rate bounds, as in the case of IFC without feedback. This was 
not immediately obvious since, with GF, each message is split into three 
parts, and not in two as for the case without feedback. 

3. We also show that when cooperation is on sending the common informa- 
tion only, the achievable rate region cannot be enlarged if the sources are 
required to decode more information than they will eventually "relay" to 
the destinations. 

4. We show how our region does reduce to the achievable regions of the chan- 
nels subsumed by the IFC-GF model. 

For the more general form of cooperation (to send both the common informa- 
tion and the private information): 

1. We extend our previous achievable region so as to include cooperation on 
sending the private information too. Our achievable region uses superposi- 
tion of several Gelfand-Pinsker binning codes. We propose a structured way 
of binning that reduces the number of rate constraints necessary to guaran- 
tee arbitrary small probability of error at the encoders. 
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Moreover, we propose to "jointly bin" the different codebooks, rather than 
perform several binning steps, one per codebook. Our proposed joint bin- 
ning is similar in spirit to multiple description source coding. 

2. The error analysis at the decoders could be very messy and lengthy with so 
many messages to decode. Our proposed method for error analysis lever- 
ages the way the codebooks are superimposed. The type of error analysis 
we use could be of interest in its own. In particular, with our encoding 
structure, we show that only 28 error events matter, out of the 2 8 — 1 = 255 
possible. 

3. We show how our new region does reduce to the achievable regions of the 
channels subsumed by the IFC-GF model. Our region however does not 
give the largest possible achievable rate for the relay channel because it 
does not include Compress-and-Forward JTo| ]. [] Extensions of the current 
achievable region so as to include Compress-and-Forward are left for future 
work. 

4. For the Gaussian channel, by means of a numerical example, we show that 
cooperation greatly increases the achievable rates with respect to the case 
without GF. 

The rest of the paper is organized as follows. Section|2]introduces the channel 
model and the notation. Section[3]revises known results for IFC without feedback. 
Section [4] presents our achievable regions; in particular, subsection |4T describes 



the region where cooperation is on sending the common message only, and sub- 



section 4.2 describes the region where cooperation is also on sending the private 



message. Section[5]evaluates the achievable region in subsection 4.1 for the Gaus 



sian channel (the evaluation of the region in subsection 4.2 is postponed to Part-II 
of this paper where we will also compare it with an outer bound). Section [6] con- 
cludes Part I of this paper. All the proofs are in the Appendix. 



2 Network Model and Definitions 

Fig. 1 shows an IFC-GF with two source-destination pairs. It consists of a channel 
with two input alphabets (Xi, X 2 ), four output alphabets (34, 34, 34, 34), and a 

'We however notice here that the performance loss due to Decode-and-Forward is less than 
within 1 bit for the Gaussian relay channel. 
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Figure 1 : An Interference Channel with Generalized Feedback with two source- 
destination pairs. 



transition probability P Yl y 2 y 3 yax x x 2 ■ We assume that all the alphabets are finite 
sets (the extension to continuous alphabets follows from standard argument flT2| ) 
and that the channel is memoryless. Source u, u E {1,2}, has a message W u 
for destination u. The messages W\ and W2 are independent and uniformly dis- 
tributed over the set {1, • • • ,e nRl } x {1, • • • , e nR2 }, where n denotes the code- 
word length and R u the transmission rate for user u, u E {1,2}. At time t, 
t E {1, • • • , n}, source u maps its message W u and its past channel observations 
Y^ 1 into a channel input symbol 

X u ,t = $(W W Yt l ) : fSS : {1, " " " , e" R "} x ^ -> X u . 

At time n, destination u outputs the estimate of its intended message W u based on 
all its channel observations Y™ +2 , i.e., 

W u = 9 { :\Y: +2 ) : : y n u+2 -+ {1, • • • , e"^}. 

The capacity region is the closure of all rate pairs (Ri, R2) such that 

max PrfWu ^ WJ ->■ as n — >• 00. 

U6{1,2} 



2.1 Notation 

The symbol i2 X2/2 is used to indicate the information rate "from source x to des- 
tination y with the help of z", with x E {1,2}, y E {0, 1, 2} and z E {c, n}. In 
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particular, y = means that the message is decoded at both destinations (com- 
mon message), y = 1 means that the message is decoded only at destination 1 
(private message for user 1), and y = 2 means that the message is decoded only 
at destination 2 (private message for user 2); z = c means that the message is 
sent cooperatively by both sources, and z = n means that the message is sent 
non-cooperatively. 

Te n \P\S) indicates the set of length-n sequences that are strongly e-typical 
with respect to the distribution P, conditioned on the sequences in S p3| . 

3 IFC without feedback 

In this section we briefly revise the best known inner and outer bound regions for 
an IFC without feedback. This will make the exposition of our coding strategy and 
outer bound easier. The channel transition probability of an IFC without feedback 
is 

Py 1 Y 2 Y 3 K 4 |Xi X 2 = Py 1 Y 2 Py 3 Y 4 |Xi x 2 > 

that is, the GF signals Y\ and Y 2 are independent of the inputs (for example = 

y 2 = 0). 

3.1 Inner Bound Region 

The largest known achievable region for an IFC without feedback is due to Han 
and Kobayashi |T9j and is as follows (6j. 

Class of Input Distributions: Consider a distribution from the class 

PqU^X^T^Y^ = (1) 

PqPu 1 t 1 x 1 \qPu 2 t 2 x 2 \qPy 3 y 4 \x 1 X2- 

The channel transition probability Py z y a \x x x 2 is fixed, while the other factors in ([T]) 
can be varied. 

Rate Splitting: The message W u E {1, e nRu }, u 6 {1,2}, is split into two 
parts (W u0n , W uun ): W u0n E {1, ...,e nRu0n } is the common information decoded 
at both receivers while W uun E {1, e nRuun } is the private information decoded 
only at the intended receiver, with R u = R u o n + Ruun- Without feedback, all 
messages are sent non-cooperativly. 

Coodbook Generation: Consider a distribution in ([T]). Pick uniformly at random a 
length-n sequences Q n from the typical set {Pq). For the codeword Q n = q n , 
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pick uniformly at random e nRl0n length-n sequences U™(k), k G {1, • • • , e™^ 10 ' 1 }, 
from the typical set Te n \Pu 1 \Q\Q n ) ■ For each codeword Q n = q n and each 
codeword U™(k) = u™(k), pick uniformly at random e nRlln length-n sequences 
Tf(m, k),m e {!,-■■ , e nRlln }, from the typical set T e {n) {Pt^qu, \q n , u n (k)). For 
each Q n = q n , U™(k) = u x (k) and T™(m, k) = t™(m, k), choose uniformly at 
random a sequence X"(m, k) from the typical set Te (Pxi\quiTi \l n , u x (k), t"(m, k)). 

The generation of the codebooks at source 2 proceeds similarly. 
Encoding: In order to send the messages W u = (W u0n , W uun ), source u, u £ 
{1, 2}, transmits X™(W u0n , W uun ). 

Decoding: Destination 1 decodes from Y" 3 n the triplet (W Wn , W 20ni W\x n ) by 
searching for a unique pair ji), ji G {1, ...,e ni?10n } and «i G {1, e nRlln }, 
and some index j 2 , j 2 G {1, e nij20n }, such that 

where 

p(decl) Sx^Ta.Xa PqPuiT^ \qPu 2 T 2 X 2 \qPy z \X 1 X 2 

^UiT x U2Y 3 \Q - p 

= -P(7iTi|Q-P(72|q( ^i|Qtfi^^2|Q£/ 2 iV 3 |XiXaJ- 

X1X2 

If no pair is found, or more than one pair is found, the receiver sets 

{iii ji) — (1) 1); m this case we say that an error at destination 1 has occurred. 

Decoding at destination 2 proceeds similarly. 
Error Analysis: The error analysis can be found in [|6j. The probability of error at 
destination 1 can be driven to zero if the rates R u = R u o n + Ruun, u G {1,2}, are 
such that 

Rim<I{Y^Ti\U 1} U 2} Q) (2a) 
# 20 n + Rim < I(Y 3 A T u U 2 \U U Q) (2b) 
Rion + Rim < I(Y 3 A T u U t \U 2 , Q) (2c) 

R20n + RlOn + Rlln < I(Y 3 A T X , U, , U 2 \ Q) , (2d) 

and similarly, the probability of error at destination 2 can be driven to zero if 

R22n<I(Y,AT 2 \U 1 ,U 2 ,Q) (3a) 

RlOn + R22n < I(Y 4 A T 2 , U X \U 2 , Q) (3b) 
i?20n + #22n < I{Y A AT 2 ,U 2 \U U Q) (3c) 
#20n + #10n + #22n < 1% A T 2 , U U U 2 \Q). (3d) 



12 



Achievable Region: The region given by the intersection of ([2]) and ([3]) can be 
compactly expressed after Fourier-Motzkin elimination as ||6): 

Theorem 3.1 ( [[6)). For any distribution in ([7} the following region is achievable: 



Ri < @), 

#2<g), 

R 1 + R 2 < min{([2d]) + pal), d2ab + pdl), pbb + pbb} 



2R X +R 2 < (2d) + (2a) + (3b), 



Ri + 2R 2 < (2b) + (3a) + (3d) 



(4a) 
(4b) 
(4c) 
(4d) 
(4e) 



Without loss of generality, one can set T x = X x and T 2 = X 2 in @, and, by 
Caratheodory's theorem, choose the auxiliary random variables (Q, U x , U 2 )from 
alphabets with cardinality \Q\ < 7, \Ui\ < + 4 and \U 2 \ < | X 2 \ + 4. 

Remark 3.2. wa^ remarked in [6] that after Fourier-Motzkin elimination, the 
following bounds also appear: 



Ri < (2a) + (3b) 



R 2 < (3a) + (2b) 



however they can be shown to be redundant. Intutively, the reason is as follows: 
if 



I(Y 3 AT 1 \U 1 ,U 2 ,Q)+I(Y 4 AT 2 ,U 1 \U 2 ,Q) = (2a) + (3b) < (2c) = I(Y 3 A 7\, U,\U 2 



at destination 2 



at destination 1 



then decoding at destination 2 constrains the rate of source 1 too much; in this 
case, destination 2 should not be required to decode the common information 
U\. Indeed, it can be shown jj^jj (see also Appendix^ that the rate points for 
which ( 2a ) + ( 3b ) < R x , but otherwise satisfy all other rate constraints in (Q), 
are contained in the sub-region of (0) obtained by choosing JJ\ = 0; thus the 



constraint R x < ( 2a ) + ( 3b ) can be removed without enlarging the achievable 



region. A similar reasoning holds for the constraint R 2 < (3a) + (2b) 
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3.2 Outer Bounds 



As shown in the second part of this paper, the outer bound techniques of [28 1 for 
the Gaussian channel, and the bound in p4| for the semi-determinisic channel, 
give: 



Theorem 3.3 ( [28 1 and [44 1). For any Pjjx 1 x 2 = PuPx 1 \uPx 2 \u, the following 
region is an outer bound for a general IFC without feedback: 

Rx<I(Xr,Y 3 \X 2 ,U), (5a) 

R 2 <I(X 2 ;Y 4 \X U U), (5b) 

Ri + Rz < /(Xi; Y 3 \Y' 4 , X 2 , U) + I(X U X 2 ; Y 4 \U), (5c) 

Ri + i?2 < I(X 2 ; Y 4 \Y' 3 , X h U) + I(X h X 2 ; Y 3 \U), (5d) 

where Py 3 ,yu\x u x 2 ( an d similarly for Py i 3 ,y a \x 1 ,x 2 ) is sucn tnat Pyu\x^,x 2 — 
Py 4 |Xi,x 2 ' i- e -> same marginal distribution, but otherwise Py 3 ,Y' 4 \Xi_,x 2 has arbi- 
trary joint distribution. 

Furthermore, if the channel is semi-deterministic as defined in in [44], that 
is, if there exist deterministic functions f 3 , f 4 , v 32 , v 4 \ and noise random variables 
Z 3 , Z 4 such that 

Y 3 = f3(Xi,v 32 (X 2 , Z 3 )) where f 3 is invertible given Xi, 
Y 4 = f 4 (X 2 , v 4 i(Xi, Z 4 )) where f 4 is invertible given X 2 , 

then 

Ri + R 2 < H(Y 3 \V 41 , U) + H{Y 4 \V 32 , U) 

- H(V 41 \X 1: U) - H(V 32 \X 2 , U) (5e) 
2R, + R 2 < H(Y 3 \V 41 ,X 2 , U) + H(Y 3 \U) + H(Y 4 \V 32 , U) 

- HiV^Xr, U) - 2H(V 32 \X 2 , U), (5f) 
R, + 2R 2 < H(Y 4 \V 32 , X h U) + H(Y 4 \U) + H(Y 3 \V 41 , U) 

- 2H(V 41 \X 1 , U) - H(V 32 \X 2 , U). (5g) 

where V 4 \ and V 32 are independent copies of V 4 \ = v 4 i(Xi,Z 4 ) and V 32 = 
v 32 (X 2 , Z 3 ) conditioned on the input (X 1; X 2 ). 

Remark 3.4. Other outer bounds exist for specific channels. For example, for the 
Gaussian channel in weak interference, Kramer [28] developed a bound based 
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on the idea of enhancing the IFC and make it equivalent to a degraded broadcast 
channels. Shang et at [52], simultaneously and independently q/"/ [33]|47| /, showed 
that for the Gaussian channel in very weak interference, it is sum-rate optimal to 
treat the interference as noise. Outer bounds based on the idea of dependance 
balance appeared in [17_ 37 J. Extensions of these bounding techniques to non- 
Gaussian channels and/or their evaluation is not straightforward and it will not 
be attempted in this paper. 



4 Inner Bounds 

In this section we derive our achievable region. We divide the section into two 



parts. In the first part (Section 4.1 ), we propose a scheme where the sources coop- 
erate by "beam-forming" part of the common messages. In this scheme, all mes- 
sages are superimposed and thus we refer to it as superposition-only achievable 



region. In the second part (Section 4.2), we propose a scheme where the sources 
also cooperate on sending part of the private messages by using binning, or dirty 
paper coding. We refer to this schemes as superposition & binning achievable re- 
gion. The superposition & binning achievable region includes the superposition- 
only achievable region as special case. We present them both to guide the reader 
into the two possible cooperation mechanisms. 



4.1 Superposition-only achievable region 

Class of Input Distributions: Consider a distribution from the class 

Pqv 1 u 1 t 1 x 1 V2U 2 t 2 x 2 y 1 y 2 y 3 y 4 = (6) 
^Q-fViC/iTiXi \qPv 2 U2T2X 2 \qPy 1 y 2 y 3 y 4 \x 1 x 2 , 

that is, conditioned on Q, the random variables (Vi, U±, Ti, X\) generated at source 1 
are independent of the random variables (V2, U2, T 2 , X 2 ) generated at source 2. 
The channel transition probability Py 1 y 2 y 3 y 4 \x 1 x 2 ls fixed, while the other factors 
in the distribution in ([6]) can be varied. 

Rate Splitting and Transmission Strategy: The message W u G {1, ...,e nRu }, u G 
{1,2}, is divided into three parts (W u0c ,W u0n ,W uun ): W u0c G {1, e nii " 0c } 
is the part of the common message sent cooperatively by the sources, W u o n G 
{1, ...,e nRu0n } is the part of the common message sent by source u alone (i.e., 
non-cooperatively), and W uun G {1, e nRuun } is the private private message 
sent non-cooperatively, with R u = R u0c + R u0n + R uun . 
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We propose that the cooperative common message sent by a source is decoded 
at the other source thanks to the generalized feedback. Then, the sources send both 
cooperative common messages to the receivers as in a virtual MIMO channels, 
thus realizing the gain of beamforming. This is possible by using regular block 
Markov superposition encoding pT| at the sources and backward decoding [ |48| 
at the destinations. In particular, transmission occurs over a frame of N slots of 
n channel uses each. Source 1 in slot b, b E {1, • • • , N — 1}, has an estimate 
W 20cb _ 1 of the cooperative common message sent by source 2 in the previous 
slot. Similarly, source 2 in slot b has an estimate W'^ cb _ 1 of the cooperative 
common message sent by source 1 in the previous slot. The random variable 
Q in ([6]) conveys the two cooperative common messages (Wioc, W 2 o c ) from the 
previous time slot to the destinations. In slot b, b E {1, • • • ,N — 1}, the random 
variables V u , U u , and T u in ^j, u E {1, 2}, convey the new cooperative common 
message W u o C) b, the new non-cooperative common message W U Q n ^, and the new 
non-cooperative private message W uun ^, respectively. 

By setting V\ = V 2 = 0, i.e., no cooperative common messages, our proposed 



encoding schemes reduces to the Han and Kobayashi [19] for the IFC without 



feedback in Th. 3.1 In this case, Q acts as a simple time-sharing random variable. 

Codebook Generation: Pick uniformly at random e n ( iJl0c+i?20c ) length- n sequences 

Q n ([i,j]), i E {!,■■■ ,e niJl0c } and j E {1, • • • ,e ni?20c }, from the typical set 

Te n \Po). For each Q n {[i, j]) = q n ([i,j]), pick uniformly at random e nRl0c 

length-n sequences V™(k, [i,j]),k E {!,■■■ , e nfll0c }, from the typicalsetTe (n ^(Py 1 |g|g n ([z,j])). 

For each Q n ([i, j}) = q n ([i, j]) and V™{k, = (k, pick uniformly at 

random e nRl0n length-^ sequences Ui(£, k, I E {1, • • ■ , e nRl0n }, from the 

typical set T^ n \p UllQVl \q n {[i,j]),v^k,[i,j})). For each Q n ([i,j}) = g n (M), 

V?(k, = v?(k, and U?(£,k, = u<?(£,k, [i,j]), pick uniformly 

at random e nRlln length-n sequences T™(m,£,k,[i,j]), m E {1, • • • ,e nRlln }, 

from the typical setT^ n) (P TllQVlUl \q n ([i,j]),v^{k, [i,j]),u?(e,k, For each 

Q n ([i, j]) = q n ([t,j]), V?(k, = v?(k, U?(£, k, = v%(£, k, 

and T"(m, £, k, [i, j]) = t™ (m, £, k, [i, j}), pick uniformly at random one sequence 

Xi(m, £, k, [i, j]) from the typical set 

T^^P^Qv^T^iihj^^^KiiJ]),^^^, [i,j]),t n i(m,£,k,[i,j])). 

The generation of the codebooks at source 2 is similar. 
Encoding: In slot b,b E {!,••• , iV}, given the new message W U)b = (W u0c ,b, W u0n ,b, W uun>b ) 
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Q 




Figure 2: A visual representation of the codebook generation for the 
superposition-only achievable scheme. An arrow to a codebook/random variable 
indicates that the codebook is superimposed to all the codebooks that precede 
it, and codebooks linked by a vertical line are conditionally independent given 
everything that precedes them. 



for u G {1,2}, the transmitted codewords are 

X?(W Un ,b, W 10nJ b, WiQcb, [Wiocfc-l, M^Ocfc-l]), 
X%(W 2 2n,b, W 20 n,b, W 20 c,b, [Wl'o C ,b-l, W 20 c,b-l\ ) , 

with the "boundary" conditions W u0c fi = W u0Cj n = 1, u — {1, 2}, i.e., on the first 
slot of the frame there is no cooperative common information from a previous slot 
to relay, and on the last slot of the frame there is no new cooperative common 
information to send because there will not be a future slot to relay it. With this 
scheme, userw G {1, 2} transmits at an actual rate R' u = (l — l/N)R u0c + R u0n + 
R U un < R u (because no new cooperative common information is sent on the last 
slot). The rate R' u can be made arbitrarily close to R u by taking the frame length 
N to be sufficiently large. 

Fig. [2] visualizes the proposed superposition coding scheme: an arrow to a 
codebook/random variable indicates that the codebook is superimposed to all the 
codebooks that precede it, and codebooks linked by a vertical line are condition- 
ally independent given everything that precedes them. For example, codebook U\ 
is superimposed to Q and V\, and it is conditionally independent of any codebook 
with index 2 when conditioned on Q. 
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Cooperation: In slot b, b G {1, • • • , iV — 1}, we can assume that the users' esti- 
mate of the previous cooperative common messages is exact, that is, W 10cb _ 1 = 

Wioc,b-i and W^ocb-i = W 2 o c ,b-i, since the total average probability of error at 
the receivers can be upper bounded by the sum of the decoding error probabilities 
at each step, under the assumption that no error propagation from the previous 
steps has occurred [ |48"| . Next we describe how source 2 cooperates with source 1. 
Source 1 proceeds similarly. 

Source 2 at the end of slot b decodes user l's new cooperative common mes- 
sage Wio C: b carried by V™ from its channel output Y^ b , knowing everything that 
was generated at source 2 at the beginning of the slot. Formally, at the end of slot 
b, b £ {I, ■ ■ ■ , N — 1}, source 2 has received Y£ h and looks for the unique index 
% G {1, ...,e nRl0c } such that 

(V?(i,[- ■■}),¥%) 

G T (n) ( p(enc2) , yn) 

where the dots indicate known message indices, where all that is known at source 2 
is represented by 

X 2 = (Q,V 2 ,U 2 ,T 2 ,X 2 ), 



and where 



P, 



(enc2) 



S C7i , Ti , X i P Q P Vi Ui Ti X 1 1 Q Pv 2 U 2 T 2 X 2 \ Q Py 2 \ X 1 X 2 



V!Y 2 \QX 2 p 

^QV 2 U 2 T 2 X 2 



If none or more than one index i is found, then source 2 sets i — 1; in this case we 
say that an error has occurred at source 2. 

Error Analysis: By standard arguments [45 ] (see Appendix [B]), the probability of 



error at source 2 can be made as small as desired if 



i^ioc < I(V 1 AY 2 \Q,V 2 ,U 2 ,T 2 ,X 2 ). (7a) 

Decoding: The destinations wait until the last slot of the frame (i.e. slot N) has 
been received and then perform backward decoding. In slot b G {N, ■ ■ ■ ,1} desti- 
nation 1 looks for the unique triplet (i 1 ,j 1 ,m 1 ) G {!,..., e nRl0c } x { 1 , . . . , e nRl0n } x 
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{1, ...,e nRlln } and some pair (i 2 ,j 2 ) € {1, e ni?20c } x {1, e nR20n } such that 

Q n ([iui2})y 1 n (W{ 0c!b ,[i 1 ,i 2 ]),U^j 1 ,Wi 0c ^ [<i,<a]),^(mi ) j 1 ,Wi 0e>6 ,[« 1 ,<2]), 
^(WSocbJii.^]), ^02,^00,6, [Ms]), 

y«\ c T--(n) / p(decl) x 
I 3,bJ ^ 1 e VQViUiT 1 V 2 U 2 Y 3 ) 

where the pair (W[ 0cb , W 20cb ) was decoded in the previous step (W u q c ,b = 1 by 
assumption, hence W^ 0c B = 1 too) and where 

Xl,T 2 ,X 2 

— PqPviUiT 1 \qPv 2 U 2 \q( P Xi\QViU 1 T 1 Px 2 \QV 2 U 2 Py 3 \XiX 2 \ 

Xi,X 2 

In words, destination 1 decodes the old cooperative common messages in Q n , 
the current non-cooperative common messages in (C/f , Ug), and the current non- 
cooperative private message in T™, from its channel output Y£ b . The current coop- 
erative common messages in (V™, V^) are known from the decoding of slot 6 + 1. 
The current non-cooperative private message of user 2 in T£ is treated as noise. 

If none or more than one triplet (ii,ji,mi) is found, then destination 1 sets 
(ix,ji,mi) = (1, 1, 1); in this case we say that an error has occurred at destina- 
tion 1. 

Error Analysis: By standard arguments [45 1 (see Appendix [C]), the probability of 
error at destination 1 can be made as small as desired if 

Rim < I(Y 3 A Tr\Q, Vt, V 2 , U u U 2 ) (7b) 

Rlln + #20n < I (Y 3 A 71, U 2 \Q, V u V 2 , U x ) (7c) 

Rim + Rion < I(Y 3 A 71, Ut\Q, V u V 2 , U 2 ) (7d) 

Rlln + RlOn + R20n < I(Y 3 A 71, U x , U 2 \Q, V u V 2 ) (7e) 

Rlln + RlOn + #20n + (#20 C + AlOc) < /(*3 A 7\, U U U 2 , Q, V U V 2 ) . (7f) 



Notice that Q < min{@, @} < max{@, (]7dJ)} < @ < @. 

By similar arguments, the probability of error at source 1 can be made as small 
as desired if 

R20C < I(V 2 A Y 1 \Q, Vl, U u 71, X,), (8a) 
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and the probability of error at destination 2 can be made as small as desired if 

R 2 2n < I(Y 4 A T 2 \Q, V 2 , V u U 2 , U x ) (8b) 
R22n + RlOn < I (Y 4 A T 2 , U X \Q, V 2 , V u U 2 ) (8c) 

i?20n + R22n < I(Y 4 A T 2 , U 2 \Q, V 2 , V U C/l) (8d) 
#20n + R22n + RlOn < J(Y 4 A T 2 , U 2 , U X \Q, V U V 2 ) (8e) 
#22n + R 2 0n + RlOn + (i?20 C + #10c) < /(*4 A T 2 , f/ 1; C/ 2) Q, V h V 2 ). (8f) 



Achievable region: The intersection of the region in ([7]) with the region in ([8]) can 
be compactly expressed after Fourier-Motzkin elimination as follows: 

Theorem 4.1. For any distribution in ([6]), the following region is achievable: 



Ri <© 

#2 < pl) 



i? 2 < Q + Q 

i?l + i?2 < Q + Q 

Ri + R2 < © + Q 

i?i + i? 2 <(0 + S + @ + ® 

i?i + i?2<@) + (|8a|) + (|l9 + (|8el) 
i?i + i?2<(N + (I^ + (|7c| + (|8c] 



2i?! + i2 2 < (j7aj) + (|7bJ) + (j7fj) + (j8cj) 

2i?x + i? 2 <2-@ + (g + (|g + (|g) + @) 

#1 + 2/? 2 < (|8ab + ((7c] + fl8bb + d8fb 



+ 2i? 2 < (J7aj) + 2 • (j8aj) + (|7cJ) + (|8bJ) + (|8ep 
Without loss of generality, one can take X\ = T\ and X 2 = T 2 in (|9]). 



(9a) 
(9b) 
(9c) 
(9d) 
(9e) 
(9f) 
(9g) 
(9h) 
(9i) 
(9j) 
(9k) 
(91) 
(9m) 



We remark here that the proposed structured way of superimposing the code- 
books greatly simplifies the error analysis. Our codebook "nesting", in fact, is 
such that the "cloud center" codebook is the one all terminals will be decod- 
ing, i.e., the cooperative common coodebok, to which we superimposed the non- 
cooperative common codebook (to be decoded by the two destinations but not by 
the other source) and finally we superimposed the non-cooperative private code- 
book (to be decoded at the intended receiver only). As a consequence, although a 
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destination has to decode five messages, only 5 out of the possible 2 5 — 1 
error events matter (see |7]) for destination 1 and ((8]) for destination 2). 
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Remark 4.2. The following rate constraints also appear after Fourier-Motzkin 
elimination: 



Ri < (7a) + (7b) + (8c) 



R 2 < (8a) + (8b) + (7c) 



(10) 
(11) 



It can be shown (see Appendix^ that (10) and (11) can be removed without 
enlarging the region in ([9]). The intuitive argument is as for the channel without 



feedback in Remark 3.2 



The achievable region in ([9]) subsumes achievable regions for other multiuser 
channels. For example: 

1. By setting (7a) = (8a) = in (j9|, we get the achievable region for an IFC 
without feedback in (|4]). In fact, ( |9e| ) is redundant because of ( [9g] ); ( |9f| ) 
is redundant because of ( |9h"| ); ([9j]) is redundant because of ( [9k] ); and (91]) 



is redundant because of (9m). With (7a) = (8a) = 0, the region in (|9) is 
unchanged if we set V\ = V 2 = Q (since the random variables Q, V\ and V 2 
always appear together). 

2. By setting Y x = F 3 and Y 2 = F 4 we obtain an IFC with output feedback 
as studied in ||24|[25j|43). In particular, the region in |24] eq.(18)-(29)] has 

However, they differ in the 



the same codebook structure of our Th. 4.1 



encoding and decoding of the messages in Q. In our achievable region, the 



sources repeat in Q the whole past cooperative common messages. In [24 1, 
the sources repeat in Q a quantized version of the past cooperative common 



message indices. In principle, thus the encoding in [24 1 is more general. 
However, in our achievable region, the destinations decode Q jointly with 
all other messages. In p4| , Q is decoded first by treating all the rest as 
noise, and then all the other messages are jointly decoded. It is thus not 
clear a priori whether the rate- saving due to sending a quantized version of 
Q are wiped out by the low rate imposed by decoding Q first. A formal 
comparison among the two regions is however difficult, since the two could 
appear different but be actually the same when the union over all possible 
input distributions is taken. 
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3. By setting (7a) = oo, and (8a) = in ([9]), we obtained a cognitive inter- 
ference channel, in which source 2 knows the message of source 1, while 
source is unaware of the messages sent by source 2. The cognitive channel 
has also been referred to as IFC with degraded message set (5TJ and as 
IFC with unidirectional cooperation [ |3T| . 

With (|7a[ = oo, and Q = (and with U x = V x = V 2 = Q without loss 
of generality) the achievable region in ([9]) reduces to: 



i2i<<0 
R 2 < 



< @ 
Ri + R 2 < 
Ri + R, 



% < © + ® 
Ri + 2R 2 < @ + g) + Q. 



(12a) 
(12b) 
(12c) 
(12d) 
(12e) 



The region in ( [12] ) is only a subset of the best known achievable region for 
a cognitive IFC by Rini et at [ |38| because the region in ([9]) does not use 
binning. 



4. By setting (7a) = (8a) = oo (and with U x = V x 



U 2 



Q 



without loss of generality) in (|9]), we obtain the achievable region with 
superposition-only for a broadcast channel (BC), namely 



#x<(7f) 



R 2 < (8f ) 



Ri + R 2 < (7f) + (8b) 



Ri + R 2 < (7b) + (8f). 



(13a) 
(13b) 
(13c) 
(13d) 



The region in ( |T3| ) is only a subset of the largest known achievable region 
for a general BC by Marton [32| because the region in ([9]) does not use 



binning. The region in ( 13 ) is however optimal for the case of "more capable 
BC channels" |[T6j and for the case of "BC with degraded message set" p3| . 

5. By setting Y 3 = F 4 = Y (and thus 7\ = T 2 = without loss of gener- 
ality) we obtain the achievable region for a multiple access channel with 
GF (481. With Y 3 = F 4 = Y and 7\ = T 2 = , we have that dvbl) = <f8bb = 



0, <7d> = (8c>, (7c) = (8d>, (7e> = (8e>, and (7f ) = (8f I, and thus the region 
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in ([9]) reduces to 



Ri < (|7a) + d7dl) 



^2 < (|8aJ) + (|7cJ) 
Ri + R2 < d7fb 



R 1 + R 2 < (7a) + (8a) + (7e) 



(14a) 
(14b) 
(14c) 
(14d) 



as derived in [48 1 



6. The region in ( 14 ) is for a MAC-GF "without common message". The case 
with common message, that is, a message W available at both sources and 
to be decoded at both destinations, can be easily incorporated by having the 
codebook/random varaible Q also carry the common message Wq. If the 



rate of the common message Wq is Rq, the region in ( 14) must be modified 



as follows: the rate constraint ( 14c) becomes 



R + Ri + R 2 < (7f) 



This trick (i.e., the random variable Q carries the common message) can 
be used whenever a common message has to be included in the IFC-GF 



setting. In particular, with a common message, our Th. 4. 1 must be modified 



as follows: the left hand side of the inequalities in (7f ) and (8f ) must also 
include the rate of the common message. 



7. Further setting R 2 = in ( 14) gives 



Ri < min{(7a) + (7d),(7f)} 



which is the achievable rate for a full-duplex relay channel with partial 
decode and forward. The above rate does not include the case of Compress- 
and-Forward JT0] | . 

8. Channels with conferencing encoders are also a special case of GF. A two- 
source conferencing model [ |48~| assumes that there are two non-interferring, 
noise-free channels of finite capacity between the communicating nodes, 
one for each direction of communication. Let CL- be the capacity of the 



conferencing channel from node j to node i. Following [29| and with some 



abuse notation, the conferencing model is captured as follows. Let the in- 
puts be Xi = [F\ \ Xi] and X 2 = [F 2 ; X 2 ], where F\ and F 2 have alphabet 



23 



sizes log(Ci 2 ) and log(C 2 i), respectively. Further set Y x = F 2 and Y 2 = F 1 
and define the channel transition probability to be 



PY u Y2,Y3,yA\[Fi;XiUF2;X2) - PYuMX^Xs 1 {Y 1= F 2 } 1{Y 2 =F 1 }- 

In this model, the choice V\ 



(8a) 



Fi and V 2 
Cyi is capacity achieving [48]. 



F 2 gives (7a) = C 2 \ and 



Remark 4.3. In 135] it is show that the region in Th. 4.1 is sum-rate optimal 
to within 18 bits for Gaussian channels with independent noises and symmetric 
cooperation links when the gain of the cooperation links are smaller than the gain 
of the interfering links. 

In the same work, it is show that when the gain of the cooperation links are 
larger than the gain of the interfering links, then the transmitters should decode 
more information from their received generalized feedback signal than they will 
actually use for cooperation. In our setting this amounts to: at the end of slot b, 
b 6 {1, • • • , N — 1}, source 1 looks for a unique index i G {1, e nR20c } and 
some index j G {1, e ni?20n } such that the sequences 



{VI 



}),U2(j,i, [•••]),!£) 

,(encl) I 
V 2 U 2 Y 1 \Q,X 1 \ 



c T( n )( p(° ncl ) I Y n 

t A € \- r V,UoYi\Q.Xi 1^1 



where the dots indicate known message indices, where all that is known at source 2 
is represented by 

J[i = (Q,V 1 ,U 1 ,T 1 ,X 1 ), 



and where 



R 



(encl) 



Y.t 2 ,x 2 PqPv 1 u 1 t 1 x 1 \qPv 2 u 2 t 2 x 2 \qPy 1 \x 1 x 2 



V 2 U 2 Yi\QXi 



P^ 



V 2 U 2 \Q 



PQViUiTxXx 

2_j Px 2 \qv 2 u 2 Py 1 \x 1 x 2 
x 2 



Decoding is successful with high probability if 

# 20 n + R20C < I(V 2 , U 2 A V u U^X^ 



(15) 



Notice that the constraint in (15) allows R 20c < I{y 2 , U 2 A Yi\Q, Vi, Ui, Ti, X\) 
while the constraint in (8a) only allowed for R 20c < I(V 2 A Yx\Q, V\, Ui, Ti, Xi). 
However, the constraint in (15) constrains R 2 o n to satisfies R 2 o n < I(V 2 ,U 2 A 
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Yi\Q,Vi,Ui,Ti, Xi) — R 2 Q C while the constraint in ( 8a ) does not constrain R 2 q u a * 



all. It is not clear at priori which cooperation strategy is better, i.e., whether (8a) 



or (15). We will show next-as intuition suggests-that the two are equivalent, that 



is, with superposition-only, the sources should relay to the destinations all the 
common information they have acquired through the generalized feedback. 

Corollary 4.4. After FM elimination of the regions in ([7|) and (|#]) with ( |ffg] ) re- 



placed by (15), we get 



Ri < min{(7f),(7a) + (7d)} 



R 2 < min{(8f),(15) + (8b)} 



Ri + R 2 < min{(7f ) + (8b), (7b) + ©, (7a) 



2R 1 + R 2 < (7a) + (7b) + (7f ) + (8c). 



(16a) 
(16b) 

@ + © + @)} (16c) 
(16d) 



It can be easily verified that the region in (\T6y is the same as region 
putedfor P QVi u 1 t 1 x 1 v'u't 2 x 2 where U 2 



com- 

(V 2 , U 2 ) (i.e., in the case 



and V 2 

of no feedback this choice corresponds to sending only private information for 
user 2 ). Hence, requiring source 1 to decode more information than actually used 
for cooperation does not enlarge the achievable region in ([9]). 

Along the same line of reasoning, one could also require that at the end of slot 
b, fo G {!,••-, N — 1}, source 1 looks for a unique indices i G {1, ...,e nR20c }, 



and some pair of indices j G {1, 
sequences 



^nR20r. 



} and k G {1, . . . , e nR22n }, such that the 



(V-(i, [•■•]), U»(j, i, [•■•]), T?(k, j, i, [■■■ ]),Y%) 
a < p( encl ) I Y n \ 

^ zl e \.- r V 2U2T 2 Y 1 \QX 1 \^-l)i 



where 



p(encl) 

r V 2 U 2 T 2 Y 1 \QX 1 



p v 2 u 2 t 2 \q[ ^ Px 2 \qv 2 u 2 t 2 Py, 
x 2 



l\Xxx\ 



Decoding is successful if 

R 2 = R22n + #20n + ^20 C < I(T 2 , U 2 , V 2 A Y^Q , V 1} U u T 1} X 1 



(17) 



The constraint in (17) can be too restrictive for rate R 2 when the cooperation link 



is weak. Indeed, consider the extreme case where Y% is independent of everything 
else (i.e., unilateral cooperation), then the constraint in ([77]) implies R 2 = 0, 



which can be easily beaten by ignoring the generalized feedback. 
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4.2 Superposition & binning achievable region 

Because the achievable region with superposition-only does not reduce to the 
largest known achievable region when the IFC-GF reduces to a cognitive chan- 
nel or a broadcast channel, we now introduce binning in the superposition only 
achievable scheme. In this new achievable scheme, the sources also cooperate in 
sending part of the private messages. 

Each message is divided into four parts: two common messages and two pri- 
vate messages. The sources cooperate in sending one part of the common mes- 
sages and one part of the private messages. Communication again proceeds on 
a frame on N slots. In any given slot, the sources decode the cooperative mes- 
sages from their GF signal; these message are then relayed in the next slot. Since 
the common messages are decoded at both destinations, the sources cooperate by 
forwarding the cooperative common messages to the destinations as in a virtual 
MIMO channel. On the other hand, the private messages are decoded at the in- 
tended destination only and treated as noise at the non-indened destination. In 
this case, a source treats the other source's cooperative private message as "non- 
causally know interference" in the next slot. Cooperation is then in the form 
of repetition/forwarding for one destination and pre-coding/binning for the other 
destination. The details of our proposed superposition & binning scheme are as 
follows. 

Class of Input Distributions: Consider a distribution from the class 

Pq ViUiTxSiZxXi V 2 U 2 T 2 S 2 Z 2 X 2 Yj Y 2 Y 3 Y 4 

= Pqs 1 s 2 Pv 1 u 1 t 1 z 1 x 1 \qs 1 s 2 Pv 2 u 2 t 2 z 2 x 2 \qs 1 s 2 Py 1 y 2 y 3 Y4\x 1 x 2 - (18) 

that is, conditioned on (Q, Si, S 2 ), the random variables (Vi, Ui, Ti, Zi, Xi) gen- 
erated at source 1 are independent of the random variables (V 2 , U 2 , T 2 , Z 2 , X 2 ) 
generated at source 2. The channel transition probability Py x y 2 Yo,y^\XyX 2 is fixed, 



while the other factors in the distribution in ( [18] ) can be varied. 

The random variables S u and Z u , u = {1,2}, which did not appear in ([6]), 
convey the previous and the new, respectively, cooperative private information in 
a block-Markov encoding scheme. 



Codebook Generation: From the input distribution in ( 18 ), compute the marginals 



PviUiT x \q and Pv 2 u 2 t 2 \q (i-e., drop the dependance on (Si,S 2 )), and construct 



codebooks (Q n , Vf, Uf, T", V 2 n , U£, T 2 n ) as described in Section |4T 

From the input distribution in ( [T8| ), compute the marginals Ps^q and Ps 2 \Q- 
Conditioned on each Q n ([i, j)) = q n ([i, j)), pick uniformly at random length-n 
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Q 




Figure 3: A visual representation of the codebook generation for the superposition 
& binning achievable scheme. An arrow to a codebook/random variable indicates 
that the codebook is superimposed to all the codebooks that precede it, and code- 
books linked by a vertical line are conditionally independent given everything that 
precedes them. 



sequences S™(ki, from the typical set Tj n ' (Pg^Q^di, j])). We shall spec- 
ify later the range of the index k in S™(ki, Similarly, generate a codebook 
S% (fe, [i, j}) by picking uniformly at random length-n sequences from the typical 
set Te n \Ps 2 \Q\q n ([i, j])). The range of the index k 2 will be specified later. 

From the input distribution in (18), compute the the marginal Pz 1 \qsiVi- For 
each triplet (Q n (M), S?(h, VT(h, [i, j})) = (q n ([ij]),s^ki,[ij]),v^ u [i,j])), 
generate a codebook Z"(mi, £i,ki, [i, j]) by picking uniformly at random length- 

n sequences from the typical set T e (n) (P Zi \qs 1 Vi 1 1 ( [h j] ) , «i {h , [i, j] ) , v? (£1 ,[i, j] ) ) . 
The range of the indices m x will be specified later. Similarly, but with the role of 
the users swapped, construct a codebook (m<2, £2, k 2 , 

Finally, for each set of codewords (Q n , S$, V{\ U?, T™, Z?) = (q n , sj, s£, uf, uj, tj, zf ) 
(we omit here the list of indices for sake of space) pick uniformly at random one 

sequence X? from the typical set T e (n) (P Xi \qs 1 s 2 v 1 u 1 t 1 z 1 \q n , s?, sg, vf, uj, , 2"). 
Similarly, but with the role of the users swapped, construct a codebook X%. 

Fig. [3] visualizes the proposed codebook generation (the convention is the same 
used for Fig. [2]). The class of input distributions in ( 18) however allows for code- 
books as depicted in Fig. |4j With binning we will force a codebook generated as 
in Fig. [3] to look like a codebook generated as in Fig. |4j 

In order to complete the generalization of the scheme in Section [4T| we must 
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(Q Si S2) 



■-►V2-^ Z2— ►U2-^T2 

Figure 4: A visual representation of the possible codebooks for the superposition 
& binning achievable scheme. 



consider each index W xyz (with the exception of the pair [Wio c ,6-i, ^20^6-1] in 
Q n ) as a pair of indices [W xyz , B xyz ], where W xyz e {1, • • • , e nRxyz } represents 
a message index, and B xyz E {1, • • • , e™^ 2 } represents a "bin index". Notice 
that each bin index B xyz has the same subscript of the corresponding message 
index W xyz and has rate R' (i.e., notice the prime in the superscript). The only 
exception is for Si and S2 where the rate of the bin index is indicated with a double 
prime as a superscript, that is, R" lc and R 22c , so as not to confuse them with R' llc 
in Z\ and R' 22c in Z 2 . 

Encoding: We can assume correct decoding of the message indices at the sources' 
side at the end of slot b — 1 (no error propagation), i.e., 

1 (carried by and to be repeated in Q n ), 
1 (carried by Z" and to be repeated in S™), 
1 (carried by V 2 n and to be repeated in Q n ), 
1 (carried by Z 2 and to be repeated in S™), 

since the total average probability of error can be upper bounded by the sum of 
the decoding error probabilities at each step, under the assumption that no error 
propagation from the previous steps has occurred [|6|[54|. 

The encoding process at the beginning of slot b consists of the following bin- 
ning and superposition steps, whose purpose is to allow the most general possible 
class of input distributions: 

• Binning codebooks S 1 ™ and S 2 against each other. At the beginning of slot b, 
given the past messages (Wio c ,&-i, W 2 oc,&-i, Wu Ctb -i, W^b-i), source 1 



Wioc,&-i = WW- 
Wii Ctb _i = Wucjb- 

^200,6-1 = W 20c,b- 
W 21c , X = W 2 lc,b- 
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tries to find a pair (&h C) &_i, &22c,6-i) such that 

^([WW-iAic6-i], [•••])> 

5 2 n ([^ 22c ,5-l,6 22c , & -l], [•••])) 

e 7T(P Sl 5 2 |Q|Q n ), 

where the dots are in place of the know messages [Wioc.fe-i, W^oc.fc-i] from 
the previous slot. If more than one pair is found, then source 1 chooses one 
at random. If the search fails, source 1 sets (&ii c ,b-i, &22c,&-i) = (1; 1); in 
this case we say that an error has occurred at source 1 . 

Error analysis. The codewords (Q n , S±, S 2 ) were sampled in an i.i.d. fash- 
ion from the distribution Pqs 1 s 2 — PqPsi\qPs 2 \q- The encoding process 
"forces" them to actually look as if they were sampled in an i.i.d. fashion 
from the distribution PqP Si s 2 \q- For that to be feasible with high probabil- 
ity we must have (see Appendix [D]) 

Rn c + R 22c >I(S 1 AS 2 \Q). (19) 

This encoding step is the same as the encoding in Marton's achievable re- 
gion for a general two-user broadcast channel with common message \ 32\. 

This first encoding step is run in parallel at both sources, so that the two 
sources have the same set of past cooperative messages (H^ioc^-i, W 2 o c ,b-i, Wiic^-ij W 2 2c,b-i) 
and of bin indices (£>ii c ,&-i, B 22cb _i). This "common knowledge" fur- 
nishes the basis for cooperation in slot b, where 

S 2 ([W 2 2c,b-1, -B 2 2c,6-l], [WlOc.b-l, W 2 0c,b-l]) 

can be treated as "non-causally known interference" at source 1, and 

S?([W Uc ,&-i j P>nc,b-i ], [WW-i, W 2 0c,6-l] ) 
can be treated as "non-causally known interference" at source 2. 

Joint conditional binning: Given the new messages (Wio C) &, W^ion.fe, Wnn,b), 
source 1 tries to find a set of bin indices (6i 0c ,b, frion.b? biin,b) such that 

(vraw Wc , b ,b 10c , b }, [■■■]), 

U?([W 10n ,b, b 10n ,bl [W 10c>b , &i 0c ,&], [•■■]), 

T™{[Wu n fi, bn n fi], [WlOn,b, &10n,b], [W^lOc.fe, &10c,fe], [' ' ' ]), 

e T™(P VlUlTl \ QSl s 2 \Q n , S", S 2 ), 
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where the dots are in place of the know previous message [Wi 0c ,&-i, W^oc^-i] 
If more than one triplet is found, then source 1 chooses one at random. If 
the search fails, source 1 sets (&io c ,6, &ion,&, &iin,fe) = (1, 1, 1); in this case 
we say that an error has occurred at source 1 . 

This encoding steps is a generalization of the "sequential binning" idea in- 



troduced in 1 30 1 . Here, instead of doing several sequential binning steps, 



we bin all the codewords at once. 

Error analysis. The triplet (Q n , 5*™, S 2 ) found in the previous encoding 
step, appears jointly typical according to Pqs 1 s 2 - The set of codewords 
(Q n , V™, Ui, TJ 1 ) is jointly typical according to -PqvWiTi by construction. 
However, codewords (V™, U™, T") and (Si,S 2 ) were generated indepen- 
dently conditioned on Q n . The purpose of this binning step is to make 
the whole set (Q n , S?, S$, V?, U?, T") to look jointly typical according to 
Pqs 1 s 2 v 1 u 1 t 1 - By standard arguments, similar to those used in Multiple De- 
scription Coding [36) (see Appendix[E]), the joint binning step is successful 



with arbitrary high probability if 

R[ 0c >I(Vi AS h S 2 \Q) (20a) 

R'ton + R'wc > I(Ui, V 1 AS 1 , S 2 \Q) (20b) 

Km + R'wn + R'wc > KYi, U U T X A S u S 2 \Q). (20c) 



The rate constraint in (20a) can be understood as follows. After the first 



(successful) binning step, the codewords (Q n , S™, S 2 , V") look as if they 
sampled from the distribution PqPs 1 s 2 \qPv 1 \q- The encoding step requires 
them to look as if they were sampled from the distribution PqPs 1 s 2 \qPv 1 \qs 1 s 2 '■> 
hence we need to be able to search among an exponential (in n) number of 
codewords V™, whose exponent must be at least H(Vx\Q)—H(Vi\QSiS2) = 
I(Vi A Si, S 2 \Q). The rate constraints in < 20b[ ) and in (20c) have a similar 
interpretation. 



Final binning step: Given the new messages Wn c ^, 
bin index bn Ci b such that 



source 1 tries to find a 



Q n (- • • ), S?(- • • ), (• • • ), Vf(- • • ), U?(- ■ ■ ),T?(- ■ ■ ) 

Z?([Wn c , b ,b Uc , b },---) 
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where the dots are in place of the know messages and bin indices. If more 
than one index is found, then source 1 chooses one at random. If the search 
fails, source 1 sets &ii C) & = 1; in this case we say that an error has occurred 
at source 1 . 

Error analysis. The set (Q n , S™, S%, V™, [/", T") found from the previous 
encoding steps, appears jointly typical according to Pqs 1 s 2 v 1 u 1 t 1 - By con- 
struction, {Q n , Sf, Vf, 

Z\) are jointly typical according to PqsiViZv that 
is, conditioned on (Q, Si, Vi), Z\ is independent of (5*2, Ui, Ti). The pur- 
pose of this binning step is to make the whole set jointly typical according 
to Pqs 1 s 2 v 1 u 1 t 1 z 1 - By standard arguments (see Appendix [E]), this binning 
step is successful with arbitrary high probability if 

R' llc > I(Z X A S 2 , U l7 Ti\Q, Si, Vi). (20d) 



• Finally, source 1 sends a codeword X x that is jointly typical with all the 
sequences found in the previous binning steps. 

Encoding at source 2 proceeds similarly. 

Cooperation: If the encoding steps are successful at both sources, all the transmit- 



ted and received signals are jointly typical according to the distribution in ( 18 ). 

At the end of slot b, source 1 knows all the messages generated at source 1 at 
the beginning of the slot, including (Q n , S%) (because we can assume successfully 
decoding of all past cooperative messages). Source 1 then searches for a unique 
pair of codeword indices and some bin index bj) such that 



V 2 n ([j,b j ],.--),Z^([i,b i ],...),Y- b ) 



c T n ( p( encl ) I Y n \ 
fc 1 e {^V 2 Z 2 Y 1 \X 1 \^-1 ) ' 

where all that is known at source 1 is represented by 

2Li — {Qi Si, S 2 , Z x , V x , Ui,T x , Xi), 

where the dots indicate known old cooperative messages and related bin indices, 
and where 

p (encl) J2u 2 ,T 2 ,X 2 PqS 1 S 2 Pv 1 U 1 T 1 Z 1 X 1 \QS 1 S 2 Pv 2 U 2 T 2 Z 2 X 2 \QS 1 S 2 Py 1 \X 1 X 2 

Pv 2 Z2Y 1 \X, ~ p 

1 ^QSxS 2 V x V Y T x Z^X x 

= Pv 2 Z 2 \QSiS 2 ( ^2 P X 2 \QS 1 S2V 2 Z 2 Py 1 \X 1 X 2 

x 2 
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Figure 5: Decoding at source 1: the variables to be decoded are circled in blue, 
the variables that are treated as noise are circled in red, the remaining variables 
are known. 



If the search fails, source 1 sets = (1, 1); in this case we say that an error 
has occurred at source 1 . 

Error analysis. From the point of view of source 1, this decoding step is equiv- 
alent to decoding the two codewords V^([W 20c ,b, B 2 o c ,b\, •••) and Z%([W 22c<b , B 22C) b], 
in a MAC-like channel with output Y[\ and state X_i known at the receiver only, 
similar in spirit to [ 50 1. Decoding at source 1 is depicted in Fig. [5] where the vari- 



ables circled in blue are to be decoded, and the ones circled in red are treated as 
noise (the rest is known). By standard arguments (see Appendix [F]), decoding is 
correct with high probability if 

Rz 2 < I(Z 2 A Yi\X x , V 2 ) + I{Z 2 A S 2 , V 2 ) (21a) 

Ry 2 + Rz 2 < I(V 2 , Z 2 A Y 1 \X i ) + I(Z 2 A S^Q, S 2 , V 2 ) + I(V 2 A St, S 2 \Q), 

(21b) 

with Rz 2 — (R 22c + R' 22c ) and Ry 2 = (R 2 q c + R' 2 o c )- Intuitively, the con- 



straints in < \2A) are a consequence of the following observations. Conditioned 
on (Q, Si, S 2 ), a wrong V 2 looks sampled from Pv 2 \QS!S 2 but it was actually sam- 
pled from Pv 2 \q', this accounts for the term I(V 2 A Si, S 2 \Q). Similarly, condi- 
tioned on (Q, Si, S 2 ), a wrong Z 2 looks sampled from Pz 2 \qs 1 s 2 v 2 but it was actu- 
ally sampled from Pz 2 \Q,s 2 y 2 \ this accounts for the term I(Z 2 A Si\Q, S 2 ,V 2 ). 
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The inequalities in pTj ) generalizes the one in (JTab, and reduce to ( fTi) when 
Si = Z\ = S 2 = Z 2 = Q. 

Decoding at source 2 proceeds similarly. 
Decoding: The receivers wait until the last slot has been received, and then pro- 
ceed to decode by using backward decoding. We can assume that when decoding 
the information sent in slot b, the decoding of the information sent in the slots 
6+1, •• • , N was successful [|6||48 1. When decoding slot b, destination 1 knows the 
current cooperative messages (W WCi b, W 2 o c ,b, Wii c ,b) carried by (Vj., Zi, V 2 ), and 
tries to decode the previous cooperative common messages (Wio C) &-i, ^200,6-1) 
in Q, the previous cooperative private message Wu^b-i in Si, and the current 
non-cooperative messages W Wn ^ b in Ui, W 20n ,b in U 2 , and Wn n ,b m T\. Decoding 
at destination 1 is depicted in Fig. [6] where the variables circled in blue are those 
whose message index is known (but the bin index is not), and the ones circled in 
red are treated as noise; the rest is to be decoded. 

Formally, destination 1 tries to find a unique set of message indices q 2 , si,Ui,u 2 , 
and some bin indices (b vi , b V2 , b zi , b si , b Ul , b U2 , b tl ) such that 



y%i,g 2 ]) 

Z?([l,b Zl ],[si,b Sl ], [l,b Vl ],[qi,q 2 ]) 

U?([u u b Ul ], [l,b Vl ], [qi,q 2 ]) 

bui\] [1) b Vl 

V 2 n ([l,b V2 },[qi,q 2 }) 

U 2 ([u 2 ,b U2 ), [l,b V2 ], [qi,q 2 ]) 

V n \ c T"( n ) ( p( decl ) ^ 
J 3,() fc J e y r QS 1 V 1 U 1 T 1 Z 1 V 2 U 2 Y 3 ) 



where 



p(dccl) 

r QS 1 V 1 U 1 T 1 Z 1 V 2 U 2 Y 3 



E 

S 2 ,X\ ,T 2 ,Z 2 ,X 2 



PqS! S 2 Pvi Ui T x Z X Xx\QSx S 2 Pv 2 U 2 T 2 Z 2 X 2 \QSx S 2 Py 3 \Xx X 2 



PqSx Pvx Ux Tx Zx\QSx Pv 2 U 2 \QSx 



E 



PxxS 2 \QSx Vx Ux Tx Zx Px 2 S 2 \QSx V 2 U 2 



P 



S 2 \QSx 



Y 3 \XxX 2 



and where, without loss of generality, we have assumed that the known messages 



have index one. Notice that the above expression for P ( 



(decl) 

QSxVxUxTxZxV 2 U 2 Y 3 



does not 
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Figure 6: Decoding at destination 1: the variables whose message index is known 
(but the bin index is not) are circled in blue, the variables that are treated as noise 
are circled in red, the remaining variables are to be decoded. 



imply that (Vi, Ui, Ti, Z\) and (V 2 , U 2 ) are independent conditioned on (QSi), 



i.e., 

(decl) 



P. 



E p (decl) 
r QS 1 V 1 U 1 T 1 Z 1 V 2 U 2 Y z 

Y 3 



PQS! Pvi Ui Ti Zi|QSi Pv 2 U 2 \QS 1 



E 

s 2 



Ps 2 \QSiVi U X n Zi Ps 2 \QSiV 2 u 2 



P 



S 2 \QS! 



not necessarily summing to 1 for all {QS\V\U\T\Z\V 2 U 2 ) 



The error analysis can be found in Appendix [Gj The probability of error at 
destination 1 can be made as small as desired if the following rate constraints are 
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satisfied: 



Ry 1 + Ry 2 + Rjj 1 


+ R Tl 


+ Ru 2 


+ R Zl 
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Ru 2 
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+ Ru 2 
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-^23 5 

(22h) 






Rux 


+ R Tl 


< min-fi^ 


-^18 ) -^24 J 


(22i) 








+ Ru 2 


< min{i?jg' ) 


-^20 ' -^25 ' -^26 J 


(22j) 










< min{£ , 2i^ 


-^27 /) 


(22k) 



where the rates .R*, * e {Q, V^, t/i, T 1; S'i, Z 1; Vi, {7 2 , ^2, S2, -Z2}, and the quanti- 
ties Ef\ie {0,...,27}, are defined in Appendix [gJ Similarly, the rate constraints 
at destination 2 are as in (22 ) but with the role of the users swapped, 
Achievable region: The achievable region with superposition & binning as a func- 
tion of -Ri and R2 only, can be obtained by applying the Fourier-Motzkin elimi- 



nation procedure to the intersection of ([19]), and (20), (21), ([22]), and the regions 



corresponding to (20), (21 ), ( [22] ) but with the role of the users swapped. How- 



ever, the rates constraints are expressed as the minimum of several quantities that 
we do not report it here for sake of space. We note that when the binning rates are 



taken to satisfy the constraints in (20) and in (21 ) with equality for both users, the 
achievable region has five types of rate bounds as for the non-feedback case, i.e., 
for R x , for R 2 , for R x + R 2 , for 2R X + R 2 , and for R x + 2R 2 . 

As for the case of superposition-only, the error analysis for the case of binning 
& superposition is greatly simplified by the structured way we performed super- 
position. In particular, only 28 error events matter out of the 2 8 — 1 = 255 possible 
that result from the joint decoding of 8 messages. 

Remark 4.5. In / [53] /, we constructed the codebooks as depicted in Fig. [7] The 
difference with respect to the encoding proposed in this paper is that Z x was 
superimposed to S 2 too (which carries the private message from source 2-sent 
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Figure 7: A visualization of the codebook generation proposed in [53 1 



cooperatively by source 1 too-but not decoded at destination 1 ), and Z 2 was su- 
perimposed to Si too. Thus, with the encoding of j\53\/, Z\ could not be decoded 
at destination 1, since its decoding implies the decoding of all messages to which 
Zi is superimposed, thus also S 2 ; but S 2 is a private message that must not be 
decoded at destination 1. Similarly, Z 2 could be decoded at destination 2. 



With the encoding proposed in /|53]/, the rate constraint in (20d) should be 
replaced by 



R' llc >I(Z 1 AU 1 ,T 1 \Q,S 1 ,S 2 ,V 1 ), 



(23) 



and the rate constraints in (21 ) should be replaced by 



Rz 2 <I{Z 2 AY l \X 1 ,V 2 ) 
Rv 2 + Rz 2 < I(V 2 , Z 2 A Y^X,), +I(V 2 A S u S 2 \Q) 



(24a) 
(24b) 



where the term I(Z 2 A Si\Q, S 2 , V 2 ) in ( |2i[ ) does not appear in (24) since Z 2 is 
superimposed to S± by construction ( thus it already has the desired joint distribu- 
tion ). In other words, the encoding of / [53] / is less stringent in terms of "binning 
rates constraints " but it is more stringent in terms on "decoding rate constraints ". 



However, these two effects do compensate one another. Indeed, from ( 24 ) and ( 23 ) 
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we have: 



R 2 2c<I(Z 2 AY 1 \X 1 ,V 2 )-R' 22c 

< I(Z 2 A Y^X,, V 2 ) - I(Z 2 A U 2 , T 2 \Q, S u S 2 , V 2 ) 
R 20c + R 22c < I(V 2 , Z 2 A + r(V 2 A S 1: S 2 \Q) - R' 20c - R' 2 

< i(v 2 , z 2 a n - /(^2 a c/ 2 , T 2 |g, 5 1; S 2 , V 2 ) 



which is the same we obtain from (21) and (20d). 

The two schemes are not the same. With the encoding proposed in this paper, 
the codeword in Z\ and Z 2 can be decoded at the corresponding destination. This 
improves on the performance since now the Z 's do not longer act as noises at the 
intended destination. 

We showed in the previous section that the achievable region with superposition- 
only in (|9]) did not reduced to the known achievable regions for some channels 
subsumed by the IFC-GF model. With superposition & binning we have: 

1 . When the IFC-GF channel reduces to a broadcast channel, our region with 
superposition & binning with only (Q,Si,S 2 ) reduces to Marton's inner 



bound for a general broadcast channel [32|. 



2. When the IFC-GF channel reduces to a cognitive channel, our region with 
superposition & binning achieves a subset of the largest know achievable 
region for a cognitive channel [ |3~8j . 

The reason why our superposition & binning region does not comprises 
the region in J38| is as follows. Assume source 1 is the cognitive user 
and source 2 is the primary user. Since the primary user is unaware of 
the message of the cognitive user, we need to set S± = V\ = Z\ = 0. 
Since there is not part of the primary user's message that is not available 
at the cognitive user, we must set Z 2 = V 2 = U 2 = T 2 = 0. With these 
choices, our encoding scheme only uses (Q, U\,Tx, S 2 ) and is equivalent to 
the scheme in |38j with U 2p b = (U 2p b in [ |3~8| carries part of the message 
of the primary user that is only sent by the cognitive user; this feature is not 
present in our encoding scheme.) 

3. When the IFC-GF channel reduces to a relay channel, our region with su- 
perposition & binning does not seem to include the compress-and-forward 
relaying strategy. 
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5 Example: the Gaussian IFC-GF 



In this section we provide an evaluation of our superposition-only achievable re- 
gion for the Gaussian channel. We will provide an evaluation of our superposition 
& binning achievable region, as well as, a comparison with outer bounds, in the 
second part of this paper. 

We assume full duplex communication, perfect channel state information at 
all terminals, and an average power constraint on the inputs. A Gaussian channel 
in standard form has outputs: 

Y c = h cl X x + h c2 X 2 + N c , N c ~ Af(0, 1), c G {1, 4} 

subject to E[|X U | 2 ] < P u , u G {1, 2}. We assume that the additive noises on the 
different channels are independent (the case of correlated noises will be discussed 
in the second part of this paper). Without loss of generality we assume that the 
direct link channel gains h^i and are real-valued since the destinations can 
compensate for the phase of the intended signal. Similarly, we assume that the 
cooperation link channel gains h 21 and h 12 are also real-valued. As opposed to 
the case without GF, the phase of the interfering link channel gains h 32 and ^141 
matter because of transmitter cooperation. 

In the following we are going to consider jointly Gaussian inputs only when 



evaluating the achievable region in Th. 4. 1 Without loss of generality, let Q ~ 
JV(0, 1) and let 

V u = a u Q + X u0c 

U u = V u + X u Q n 

T u X u U u -\- X uun , 

forw G {1,2}, where (ai,a 2 ) G C 2 andX m ~ Af(0, a 2 m ) for m G {10c, lOn, lira, 20c, 20n, 22n} 
are independent random variables whose variances satisfy 

< \a u \ 2 + a 2 u0c + a 2 u0n + a 2 uun < P u , u G {1, 2}. 
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The right hand side of the rate bounds in region ([7]) are then 



(7b) 



(7c) : 



(7d) 



(7e) : 



(7f): 
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1 + |^32| 2 Cr| 2n 

and similarly for the other user. Notice that, conditioning on Q removes the de- 
pendency between X\ and X 2 . The cooperation gain shows in eq. f7fj) (w here 
instead of |/i 3 io;i| 2 + |/i32Q;2 1 2 one has \h 3 icti + h 3 20t2\ 2 ) and in equation (7a). The 
private message X 2 2n {Xu n ) acts as noise for destination 1 (destination 2). 

For the purpose of numerical example, we consider a symmetric network 
where, in a two dimensional Cartesian place with x > and y > 0, source 1 is in 
position (— x/2, —y/2), source 2 is in position (— x/2, +y/2), destination 1 is in 
position (+x/2, —y/2), and destination 2 is in position (+x/2, +y/2). Both users 
have the same power constraint P and the channel gains are inversely proportional 
to the distance between the terminals, that is, h 2 \ = h 12 = h 34 = h 43 = l/y, 
hi = h 13 = h 2i = h i2 = 1/x and h 41 = h u = h 23 = h 32 = 
Fig. [8] shows the performance of our superposition-only scheme and compares 
it with the case without generalized feedback, for the case Pi = P 2 = 6 and 
x = 2 and y — 1. It can be seen that great rate improvements are possible 
thanks to cooperation, when compared to the case without GF. For example, the 
maximum rate for a given user improves from 1.3 bit/sec/Hz to 1.9 bit/sec/Hz 
(1.9=1. 3x(l+0.46), i.e., 46% improvement), while the sum-rate improves from 
1.7 bit/sec/Hz to 2.2 bit/sec/Hz (2.2=1. 7 x (1+0.29) , i.e., 29% improvement). 
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Figure 8: Performance comparison among standard IFC and IFC-GF. 

6 Conclusion 

In this paper we presented an achievable region for a general IFC-GF We built 
on the idea of message splitting into common and private messages and proposed 
a coding scheme where the sources cooperate to send part of the two messages. 
The cooperation in sending the common message aims to realizing the gains of 
beam-forming, as in a distributed multi-antenna system, while the cooperation in 
sending the private message aims to leverage the interference "pre-cancellation" 
property of dirty -paper-type coding. We showed that our achievable region gener- 
alizes several known achievable regions for IFC-GF and that it reduces to known 
achievable regions for some of the channels subsumed by the IFC-GF model. Nu- 
merical results show that cooperation can improve the achievable rate of all the 
involved sources. In the second part of this paper, we will derive an outer bound 
for a general IFC-GF and use to assess the performance of our proposed achiev- 
able strategy. 
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A Proof of the redundancy of two single-rate con- 
straints 



For a fixed distribution Pqv 1 u 1 t 1 x 1 v 2 u 2 t 2 X2 consider another distribution Pq'v(v' x t[x x v 2 u 2 t 2 x 2 
with 

V ; = U[ = fH, T[ = (T^tfi), Q' = {Q,V X ), 

that is, source 1 does not send any common information. With Pqiv{U[t{x x v 2 u 2 t 2 x 2 , 
the achievable region in Q reduces to: 



Ri < ([7dj) 
R 2 < ©' 
R2 < S + @' 

i?i + R2 < (0) + B' 

Ri + R2 < (N + pel + J8bl' 



(25a) 
(25b) 
(25c) 
(25d) 
(25e) 



where a prime as a superscript indicates that the mutual information in the cor- 
responding equation must be computed for the distribution Pq>v{u't'x x v 2 u 2 t 2 x 2 
(rather than for the distribution Pqv 1 u x t 1 x 1 v 2 u 2 t 2 x 2 )- Notice that all the mutual in- 
formations in Q are larger under Pq'v;u[t[x x v 2 u 2 t 2 x 2 than under Pq Vx u x t x x x v 2 u 2 t 2 x 2 
and satisfy 



< @' = @' = @) 
< @' = ©' = @ 

(@' = o, 

while the mutual informations in (f8l) under PQ/v^TpCiVbt^J^ satisfy 



< @)' = @)' = I(Kt A T 2 |Q, V^i, V 2 , C/ 2 ) 
< @' = @' = /(n A T 2 , E/ 2 |Q, 14, V 2 ) 

e' = (B = /(V 2 A Yi|Q, 7i, U u Vt,Xt). 
Consider the region in d5b (under Pq Vx u x t x x x v 2 u 2 t 2 x 2 )- If 



(7a) + (7b) + (8c) > min{ (7f ) , (7a) + (7d)} 



in l9a|l 



in ffl 
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then the rate constraint in (TTOb is redundant and can be omitted from the region 



in ([9]). We will now show that the rate constraint in (10) can always be omitted 
from the region in ([9]) without enlarging the achievable region. We will do so by 
showing that the rate points for which the rate constraint in ( 10) is violated, that 
is, when 



(7a) + (7b) + (8c) < R x < min{ (7f ) , (7a) + (7d)} 



(26) 



{Tof 



in teal 



in tebl 



holds together with all the rate constraint in ([9]), are contained in the region in (25 ) 



(under Pq'v{u[t{x 1 v 2 u 2 t 2 x 2 )- The region in (25) is a special case of the region 
in for which the rate constraint in ( 10) is redundant. This shows that the region 
in ([9]) is indeed achievable. 

Assume now that (26) holds together with all the rate constraint in ([9]) (under 
Pqv 1 UiT 1 x 1 v 2 U2T 2 x 2 )- We will show that that (26) and ([9]) imply (25). We have: 
(f25ab = d9bl. Moreover 



R2 < g§ + ® - (© + @ + (g) 



in tefl 



I(Y 4 ;U 2 ,Q,V 1 ,V 2 ) - I(Y 2 ;V 1 \2C Z ) 



<I(Yi;T 2 ,U 2 ,Q,V u V 2 )-0= g' 

in E5b 



and 



i? 2 < d7ab + dliH) + (J7bl) + pil) - (fl7ab + d7b|) + d8c|) 



in teh] 



(8a) + I(Y 4 ;U 2 \Q,V 1 ,V 2 ) 



<^ + I(Y 4 ;T 2 ,U 2 \Q,V u V 2 ) = (8a) + (8d)' 




and 



Ri + R2 < Q + gg + Q + Q -(gg + g§ + gg) 



in ((^ 



< (7f) + (8c)' 
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and 



Rt + R 2 < + + (gg + g§ + Q -fgg) + (|7§ + (Q) 



in d9kl 



(7a) + (8a) + (7e) 



< (7a) + (8a) + (7e) + (8b)'. 



y — " 

in j25ol 



This concludes the proof. 



B Proof of (7a) and of (8a) 



At the end of slot b, b E {1, ■ ■ ■ , N — 1}, transmitter 1 has received Y™ h and looks 
for the unique index i E {1, e nR20c } such that the sequences 



(v?(v"),i7M 

GTW(P y2 | Q P yi | Q ^,y 2 |Q n ,X- 



(27) 



where the dots indicate known message indices, and where all that is known at 
transmitter 1 is represented by 

Zi =(Q n ,V 1 n ,U?,T?,X?). 

If none or more than one index i £ {1, ...,e nR20c } are found, then transmitter 1 
sets i = l. 

Assume message i = 1 was sent. An error occurs when transmitter 1 declares 



i ^ 1 in (27 ), which occurs with probability 



Pr[z ^ 1 1 X sent] 

= PrfU^V^v-O,^) G T^(P V2lQ P YlUKi y 2 \Q n ,2Q)] 



e nR 20c 

E 

i=2 

< e n[fl 2 0c+H(V 2 |Q)+H(yi|Q,X l! V 2 )--ff(V r 2|0)-H(yi|Q,X 1 )+O(e) 



3 n[ii 2 0c-/(iiAV 2 |Q,X 1 )+O(e)] 
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because V 2 and Y x are independent conditioned on Q for any i ^ 1. The error 
probability goes to zero if (8a) holds, where 0(e) denotes a function of e that goes 
to zero when e — > 0. 

Similarly, we can prove (15) and (17) as follows. We only give the proof 
for (fT5l). Assume i = 1 was sent. An error occur if the search for 



(28) 



iq b ,x?: 



results in an i 7^ 1. Thus an error occurs with probability 
Pr[i ^ 1|1 sent] 

= PrfU^M^i, ■ ■ • ), t^0'» V • • " ). £ T^(Py 2tU2lQ Py llQ , Ku y 2tU2 \Q n , X? 



< 



e nR 20c e nR 20n 



/] \Te n \Pv2,U 2 \QPY 1 \Q,X 1 ,V 2 ,U 2 \Q' n \ Ki) I Pv 2 n ,U%\Q*Py?\Q™ ,X™ 



i=2 j=l 

< e n[i?20c+i?20n+H(V'2,C/2|Q)+^(yi|Q,Xl,V2,%)-H(V2,l/2|Q)-H(y 1 |Q,X 1 )+O(e)] 
= e n[ J R20 c +fl20n-/(llAy 2 ,f/2|Q,Xi)+O( £ )] 

because (V 2 , U 2 ) and F x are independent conditioned on Q for any % ^ 1. Hence, 
the probability of error vanishes as the block-length increases if (fT5j) holds. 



C Proof of © and 



For the error analysis, we consider only the probability of error in each block as the 
total average probability of error can be upper bounded by the sum of the decoding 
error probabilities at each step, under the assumption that no error propagation 
from the previous steps has occurred [[6}54|. 

Receiver 1 looks for the unique triplet (51, «i, £1) and some pair (q 2 , u 2 ) such 
that the sequences 



Q n ([qi,q2]),V 1 n (W 10Cib , [qi,q2]),U?{ui,W 10c , b , [qi, q 2 \), T?(h, u 1: W 10c , b , [qi,<h]), 
V 2 n (W 20c , b , [ qi , q 2 }), U?(u 2 , W 20c>b , [ qi , q 2 ]), 
e rp{n) (P Q P Vi jj x tTl \QPv 2 ,U 2 \qPy 3 \Q,Vi ,U u Ti ,v 2 ,u 2 ) , (29) 

where (Wioc&j W 20Cyb ) were decoded exactly in the previous step. Let E qiq2U1U2tl 
be the event that the sequences in ([29]) are strongly jointly typical. Assume that 
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(<?i<?2WiM2^i) = (Hill) was sent. The total probability of error at receiver 1 can 
be bounded as 

P^l — P r [-^lllll U (gi«iii)^(Hl),V(g 2 «2) ^9i92iii«2*i] - P^nm] 
+ 2J P r [ U (gi«iti)^(lll)-E'gig2Mi«2ti] + P r [ u (g 1 M 1 t 1 )^(iii)-E' (?1 iMilii] 

q 2 >l,U 2 >l 

+ 2J Pi'[U( (?lUltl )^(iii)£ , g 1 i UlU24l ] + 2^ Pr[U(g ini i 1 )^(in)i? (?1(?2Ul i tl ] 

«2>1 92>1 

where all probabilities are conditioned on the event that (9152^11x2*1) = (11111) 
was sent. 

The probability of the event E^ 11U vanishes because the transmitted code- 
words are jointly typical with the received sequence with high probability. 

Although it seems we need to consider 7 x 4 = 28 different error events, all 
events with (51(72) 7^ (1, 1), i.e., Q n wrong, are such that the estimated codewords 
are independent of the actual transmitted ones, and hence of the output. Hence, 
the probabilities that either q 1 7^ 1 or q 2 7^ 1 are dominated by 

P^Eijkim] (30) 

j>l,j>l,fc>l,£>l,m>l 

for which we have 

k£m I 

< I T e n (PqPv! ,Ui ,t 1 \qPv 2 ,u 2 \qPy 3 \ Vi ,Ui ,n ,v 2 ,u 2 ,q)\ 
Pq™ Pv? ,U? ,T"\Q n Pv 2 n ,u%\Q n Pyg 

< e -n(+H(Q)+H(V 1 ,Ui,Ti,X 1 \Q)+H(V 2 ,U 2 \Q)+H{Y3\Q,Vi,U 1 ,T 1 ,V 2 ,U 2 )) 
e -n(^H(Q)-H(V 1 ,U 1 ,T 1 ,X 1 \Q)~H(V 2 ,U 2 \Q)-H(Y 3 )+0(€)) 

< e -n{I{Y 3 AQy 1 ,U 1 ,T 1 y 2 ,U 2 )+0{e)) 



Hence, the probability in ( |30| ) vanishes as n — > 00 if ( |7f| ) holds. 

Besides the events with (qi, q 2 ) 7^ (1, 1), the other probability affecting P^ 
are as follows. From now on (51, q 2 ) = (1, 1), i.e., Q n correct. Recall that when 
Q n is correct, also V™ and V 2 n are correct. 

The events with (ui > l,ti = 1) and (ui > l,t 1 > 1), i.e., U™ wrong, have 
the same probability since, once is wrong, the received signal is independent 
of the chosen (C/f (m, ■ ■ ■ ), T^(t%, ui, ■ ■ • )) conditioned on the transmitted/correct 
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(Q n , V™). This is so because, even if t\ = 1, the chosen T" is not the transmitted 
one because superimposed to a wrong C/f , Hence, if «2 = 1, ^ correct, we 
have 



Pr[^iuim] 

fc>l,m>l 

< l r "(^QAi,^i,ri|QA'2,{/2|Q-pK3|yi,c/i,Ti,y2,c/2,Q)l 

fc>l,m>l 

< ^ e n(+if(Q)+i?(Vi,ai ) T 1 ,Xi|Q)+H(V2,C/2|Q)+H(Y3|Q,Vl,Ui,Ti ) V 2 ,!72)) 
fc>l,m>l 

e n{-H(Q)-H(V 1 ,Ui,T 1 ,X 1 \Q)-H(V 2 ,U 2 \Q)-H(Y 3 \Q,V 1 ,V 2 ,U 2 )+0(e)) 

_ „n(Rl0n+iJlln-/(V3Af/l,T 1 |Q,y i ,V 2 ,C/2) + O(e)) 



which gives (|7d]); while if u 2 > 1, i-e-, U% wrong, we have 

llk£m\ 

e>l,k>l,m>l 

< \ T e( P Q P V 1 ,U 1 ,T 1 \QPv2,U 2 \QPY 3 \V 1 ,U 1 ,T 1 ,V 2 ,U2,Q)\ 
e>l,k>l,m>l 

PQ n Pv™ ,11? ,T{ l \Q n Pv£,U%\Q n PYg\Q n ,V£ ,U™ ,U% 

< e n (+ H (Q)+ H (Vi,Ui,T 1 ,x 1 \Q)+H(v 2 ,u 2 \Q)+H(Y 3 \Q,v 1 ,u 1 ,T 1 ,v 2 ,u 2 )) 

e>l,k>l,m>l 

e n(-H(Q)-H(V 1 ,U 1 ,T 1 ,X 1 \Q)-H(V 2 ,U 2 \Q)-H(Y i \Q,V 1 ,V 2 )+0(e)) 
_ a n(R 2 on+Rion+Rim-I(Y3^T 1 ,U 1 ,U 2 \ Q,Vi,V 2 )+0(e)) 



which gives ( |7e| ). 

From now on (qi,q2, Ui) = (1, 1, 1), i.e., Q n and C/f correct. If w 2 = 1, i.e., 
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U£ correct, and t\ > 1, i.e., T" wrong, we have 
^Pr[£ llllm ] 

m>l 

< E \ T e( P Q P V 1 ,U 1 ,T 1 \QPv 2 ,U 2 \QPY 3 \V 1 ,U 1 ,T 1 y 2 ,U2,Q)\ 
m>l 

Pq™ Pv^,u^,Tf \Q n Pv?,u%\Q n Py£\Q n ,u™ ,u% 

< ^ e -n(+H(Q)+H(Vi,C/i,Ti,Xi|Q)+i?(V2,£/2|Q)+-H"(^3|Q,V l! C7i,ri,V 2 ,C/2)) 
m>l 

e -n(-H(Q)-//(yi,^i,Ti,Xi|Q)-H(V2,l/ 2 |Q)-H(y3|Q,Vi,'l / 2,C/i,(72)+0(e)) 
_ „n(i?n n -/(y 3 ATi|Q,Vi,i7i,V 2 ,C/2)+0(£)) 



which gives (7c), while if w 2 > 1, i-e-> ^2 wrong, and t 1 > 1, i.e., T™ wrong, we 
have 

llUml 

i>l,m>l 

< 2j (^"(PQPVi.ai.TilQPva.C/alQPralVi.C/i.Ti,^,^^)! 
£>l,m>l 

< ^ e n(+H(Q)+H(V 1 ,ai,T 1 ,Xi|Q)+H(V2,a2|Q)+H(y 3 |Q,Vi,i7i,T 1 ,V2,a2)) 
£>l,m>l 

e n(-H(Q)-H(V 1 V 1 ,T 1 ,X 1 \Q)-H{V 2 ,U 2 \Q)-H(Y z \Qy 1 y 2 V 1 )+0{e)) 

_ „n(i?20n+Rlln-/(y3ATl,l/ 2 |Q,Vl,l/l,y2)+O(e)) 



which gives (7b). 



The developed analysis can be summarized as in Table [TJ In Table [T] the symbols 
"1", "0" and "★" have the following meaning. A "1" indicates that the message 
index is in error. A "0" indicates that the message index is correct. A 'V indicates 
that it does not matter whether the message index is in error; this is so because of 
superposition coding; in this case in fact, the codeword selected by the decoder- 
even though with the correct message index-is superimposed to a wrong codeword 
and it is thus independent of the received signal. In case of a the factorization 
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Table 1 : Error events at c 


estination 1. 




1 2 3 4 

[<7l,<?2] «i t x u 2 


N 


C 




I * * * 


2 3 





£?> 


1*1 


2 


QVM 




1*0 


2 


QV 1 V 2 U 2 


cm 


Oil 


1 


QV 1 V 2 U 1 




10 


1 


QV 1 V 2 U 1 U 2 


OK-not an error 


* 


2 


all correct 



of the joint probability needed for the evaluation of the probability of error is as 
for the case where the message is wrong; this implies that the error event that 
gives the most stringent rate bound is that for which the message is wrong (i.e., as 
far as error bounds are concerned, a "★" is equivalent to a "1"). The second to last 
column in Table[T]counts how many error events are included in the corresponding 
row (i.e., each 'V corresponds to two possible cases), and the last column lists 
the elements of the sect C, where C is the set of correctly decoded codewords. 



D Proof of (19) 



The probability that encoder 1 fails to find a good pair of indices -Bn c ,b-i = i, 
B 22C)h -i = j is 



Pr [u,>ij>i(^([iy llc , 6 -i^],[w 10c , fe _i,w 2 o c ,6-i]), 

S 2 n ([WWi, j], [W 10c>b -i, Wwa-i])) # T:(P QSlS2 \Q n )} 
= (l—p) < expt-e"^'"^ 2 ^ p) 

< exp (_ e ™(^ii c +«22 C -^(5'iA5 2 |Q)--0(e))^ 



53 



which goes to zero as n — > oo if (fT9)) holds, where 



p = PT[(S?(\W li£tb -i, i], [W 10c>b -i, Wwct-i]), 

su[W22c, b -i,j], [WW-!, ww-i])) e T e n (p Q5lS2 |g n )] 

< |T"(P Q 5 1 5 2 |(5 n )|P5n|QnP S n|Q„ 

< e n(H(S 1 S 2 |0)-H(Si|Q)-/r(5 2 |Q)-O(e)) 
_ p n(-/(SiAS a |0)-O(e)) 



where 0(e) -> as e -> 0. 



E Proof of (20) 



Encoding fails if for all set of indices (_Bi 0c ,6, B Wn ^, -Bii n ,&) can be found no triplet 
(V7\ E/J 1 , T?) can be found to be jointly typical with (Q™, S™, S%). The probability 
of this event can be bounded as 



where 



e "H'l0c e nR 10n e nR llr, 



Mfi n n 

SlOc — 1 BlOn — 1 Sn„ = l 

^([^XO^PlOc],---), 
^T([Wl0n,6) -BlOn], [WlOc,&, B Wc ], • • • ), 
T"([Wli nj 6, -Blln], [VFiOn.b, B 10n ] , [WiOc.b, -BlOc], " " " )) 

^ ^T(- p Q,si,5 2 ,vi,t/i,TiiQ n , s?> 5*2)] 

Var[K] 



Pi[K = 0] < 



E 2 [if] 



^ = X/ X] X] K B Wc ,B Wn ,B llr , 
Sx0c=l -Bl0n=l Slln=l 
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for 

K B 10c ,B 10n ,B lln = 1{ 
Vr([W 10c , b ,B 10c },---), 

Ui([WiOn,b, B Wn ], [WiQc,b, -BioJ, • • • ), 
Tl([Wu n ,b, Bu n ], [WiOn,b, B Wn ], [W WCj b, B Wc ], ■ • • )) 

e T T e l (PQ,s 1 ,s 2 ,Vi,Ui,T 1 \Q n , £?> S%)} 

and l{ A y is the indicator function that equals one whenever the condition in A is 
true. 

The mean of the random variable K is easily lower bounded as 

e nR 10c c nR '\0n, e" B U» 

E w = E E E p r[ 

SlOc = l -BlOn = l Bn„ = l 

^([WlOc^Sxoc],---), 

Ui([W 10nj b, B 10n ], [W WCj b, -Bioc], • • • ), 

^([Wlln.&j -Blln], [Wl0n,6, B 10n ], [W 10c ,b, B 10c ] , • • • )) 

e nfl 'iOc e " fl 'lOn c nii 'nn 
= E E E l T "(^Q,5i,52yi,C/i,T 1 |Q™,5'r)'S'2)|- P V7,C/ 1 ™,Tf|Q« 

SlOc=l SlOn=l Sn n =l 

> exp{n[i2i 0c + R' Wn + R' lln + H(V U U^T^Q, S u S 2 ) - H(V U U^Q) - 0(e)]} 
= exp{n[R' 10c + R' Wn + R[ ln - I(S 1 , S 2 A V,, U 1 , T,\Q) - 0(e)]}, 

and upper bounded as 

E[K] < ex P {n[R' 10c + R' Wn + R' Un - I(S U S 2 A V u U u T X \Q) + 0(e)]}. 
The variance of K can be computed as 

e nR 10c e nR 10n e" fl iln e nR 10c e nR Wn e nR 'lln 

v«[«i = E E E E E E 

Bioc=l BiOn=l Bu„=l BJ 0c =l B' Wn =l B' lln =l 
(PrlK Bl0c ,B 10n ,B lln = l i K B> Wc ,B> Wn ,B> lln = 1] 

- Pr[K Bl0c , Bl0n>Blln = 1] P*[K B [ 0c ,B[ 0n ,B[ ln = I])- 
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When B 10c ^ B' 10c , the random variables K BlOcjBl0njBlln and K B' 10c ,B' 10n ,B' lln are 
independent by construction, hence they do not contribute to the summation. 
When B Wc = B' Wc , we upper-bound Var[K] by neglecting the non-negative term 

Pr[/^ 10c ,B 10n , Blln = 1] M K B[ 0c ,B' 10n ,B[ ln = 1]. Hence we have 

Var[K]< Yl E E ^iWW»u. = l] 

-Bi 0c =-Bi 0c Si07i=Sj 0n _Bn n =S( ln 

+ E E E P r [^Bl()c,BlOn,Blln = !] P r [^BlOc,SlOn,Bi ln = ^-^BlOc^lOn^lln = !] 

+ E E E Pr [^ioc,BiOn,-Bn n = 1] P r [-^Bio c ,Bion. B im = l\ K B 10c ,B 1Qn ,B lln = 1] 

SiOc=-Bloc ( B iOn, B' 10n ^B 10n ) (B Un , B' lln ) < c -nS 

< e n[fl' 10c +i?' 10n +i?i ln -/(S 1 5 2 Ay 1 f/ 1 T 1 |Q)-O( e )] ( ^ 1 + e n[iJ' lln -A] + e n[R' Wn +R' lln -B]j 

We now evaluate A and B. We have, neglecting the terms that go to zero as e — > 0, 



-riB 



and 



<- ^(fJi.TilQAA.VO-n^C/i.TilQ,^) 
< e -nI{U 1 ,T t /\S 1 ,S2\Qyt) 

= Pr[T? e T:(P QtSuS2 y uUuTl \Q\ S» U»)\ 

< e nH(T 1 |Q,Si,5 2 yi,t/i)-n//(Ti|Q,Vi,l/i) 

< Q-nI{T 1 hS l ,S 2 \Q,Vi,Ux) 



After having evaluated A and B, we have that 



Var[if] 1 + e n[R, "«" A1 + e n[ii 'ion+- R iin- s ] 

W[K] ~ e n [«ioc + -Rio n +«iln- / (SlS2A^iI/iT 1 |Q)] 



goes to zero as n — >■ oo if ( 20 ) holds. 



F Proof of (gp 

Let 

^ = (W l (|> , ,6i],---).^([<.6i 
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where all that is known at transmitter 1 is represented by 

xx = (Q™, s» si 2%, V?, U?, T™, X?). 

Assume that (z, j, 6 i; = (1111) was sent. The probability that the estimate of 

(j, i) = (W 2 oc,b, W 2 2c,b) is wrong is bounded by 

P^encX = Pr [^llll U(ij)^(ll),V(b l ,fe J ) E ijk ] 

<Pr[^ m ]+ Pr [Uv(W*Wj] 

i>l,j>\ 

Vbi-EilbibA 

i>l i>l, bj >l 

+ £Pr[u v6j £ w J + P*[Uv bj E ljbibj ] 

i>i j>i,&i>i 

where all probabilities are conditioned on (i,j,bi,bj) = (1111) being sent. 

The probability of E{ 1X1 is vanishing as n — > oo because the transmitted code- 
words are jointly typical with the received signal with high probability. 

For the other three terms we have: \fi > l,j > 1, i.e., when V 2 n is wrong then 
whether Z^ is correct or wrong does not change the distribution to use in the error 
events and the most string error bound is for the case where both are wrong; thus 
we have 

«>i,j>i 

< Y I T ™ Zz\QSi S 2 PYx I QSx S 2 V 2 Z 2 X 1 \Kl) I Pvn \qPz 2 \QS 2 V 2 Pyi \QSx s 2 x^ 
i>l,j>l, b i>l, b j>l 

< e n[R 22c +R 2 oc+R 22c +R' 20c ] 

e n[H(V 2 \QS 1 S 2 )+H(Z 2 \QS 1 S 2 V 2 )+H(Y 1 \QSiS 2 V 2 Z 2 X 1 )} 
e -n[H(V 2 \Q)+H(Z 2 \QS 2 V 2 )+H(Y 1 \QS 1 S 2 X 1 )] 

< e n[R 22c +R 20 c+R 22c +R 20c -I(V 2 ASiS 2 \Q)-I(Z 2 AS 1 \QS 2 V 2 )-I(Y 1 AV 2 Z 2 \QS 1 S 2 X 1 )} 

since by construction V 2 and Z 2 are independent conditioned on Q and Z 2 is su- 
perimposed to (5*2, V 2 ). This probability can be driven to zero if (21b) holds. 
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Finally, if i > l,j = 1, i.e., V 2 correct and Z 2 wrong, we have 

^Pr[U V6 ,£W] 

i>l 

< l r ™(- P V-2Z 2 |QSi52-Pyi|Q5iS 2 y 2 ^2Xi \^T)\Pv 2 \QS 1 S 2 Pz 2 \QS 2 V 2 Py 1 \QS 1 S 2 V 2 X 1 
i>l,6i>l 

< e n[i?22c+-R 2 2 c ] 

e n[ J H"(V 2 |Q5 1 5 2 )+//(Z 2 |Q5i5 2 y 2 )+H(y 1 |Q5 1 5 2 y 2 X 1 )] 
e -n[H(y2|QSi52)+H(22|Q52V2)+H(Yi|QSiS 2 y 2 X 1 )] 

< e n[R22 C + J R2 2c -^(^2A5 1 |Q5 2 V2)-/(riAZ 2 |Q5i5 2 V2X 1 )] 

since now the V 2 has the marginal imposed by the binning step during the encoding 



process. This probability can be driven to zero if (21a) holds 



G Proof of (22) 



In slot b, b — N, N— 1, 1, destination 1 tries to find a unique set of message in- 
dices (qi,q2,si,ui,U2,ti) and some bin indices (b Vl , b V2 , b Zl , b Sl , b Ul , b mi b tl ) such 
that 



G" ([<&,*]) 

V?([l,&J,[gi,<&]) 
Z^[l,b Zl ],[s 1 ,b Sl ],[l,b Vl ],[q 1 ,q 2 }) 

U?([u u b ui ], [1AJ, [gi,g 2 ]) 
T \{[tiAi\, [ui,b Ul ], [l,b Vl ], [q u q 2 ]) 
V 2 n {[l,b V2 ],[ qi ,q 2 }) 
U 2 ([u 2 ,b U2 ], [l,b V2 ], [qi,q 2 ]) 

V n \ c TH/p( decl ) ^ 
*3,b ^ A e \ r QS 1 V 1 U 1 T 1 Z 1 V2U 2 Y 3 ) 



where 

p(decl) 

r QS x VxV x T x Z x V 2 U 2 Y i 
= PqS 1 Pv 1 UiT 1 Z 1 \QSiPv 2 U 2 \QSi 



Px 1 S 2 \QS 1 V 1 UiT 1 Z 1 

s 2 ,x x ,x 2 



X 2 S 2 \QS!V 2 U 2 



p f 



S 2 \QSi 



(31) 



Y 3 \X!X 2 
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Table 2: Error events at destination 1. 





1 

[91. 92] 


2 

[!,&„! ] 


3 

[«1, 


4 

[tl,b H ] 


5 


6 

[hb xi ] 


7 

[l,b„ 2 ] 


8 

[u 2 , bu 2 ] 


N 


C 


£ (1) 


1 
















2 7 





£ (1) 
Jl) 

£ <1) 







1 
1 
1 


* 






» 


1 


1 



2 4 
2 3 
2 3 


Q 

Q, V 2 
Q, V 2 , C7 2 


e u 

% 
% 












1 
1 
1 




; 




1 


1 




2 3 
2 2 
2 2 


Q,Vi 
Q,V 2 , Vj 
Q, V 2 ,(7 2 , Vi 


M) 

£ 7 

£ (1) 

£ d) 

















1 
1 
1 








1 




2 2 
2 1 
2 1 


Q,Vi,C/i 
Q.Va.Vi.C/! 
Q,Va,C/ 2 , Vi,Ui 


S W 
% 
% 

c 12 














(1 






(1 




! 


* 




1 




2 2 
2 1 
2 1 


Q,V 1 ,U 1 ,T 1 

Q,V 2 ,V 1 ,U 1 ,T 1 

Q,V 2 ,U 2 ,V 1 ,U 1 ,T 1 


£ (1) 
1?* 

£ U) 







1 
1 
1 


* 


« 







• 


1 


* 
1 




2 4 
2 3 
2 3 


Q,Si 
Q,Si,V- 2 
Q,Si, v 2 ,c/ 2 


£ d) 

£ tl) 
c 17 
£ d) 


















(1 




1 
1 
1 




1 




2 2 
2 1 
2 1 


Q.Sj, V 2 , V X 
Q,Si,V 2 ,!7 2 , Vj 


£ (1) 
£ tl) 

c 21 














(1 




1 
1 
1 




(1 




1 
1 
1 




1 




2 1 
2° 
2° 


Q.Si.Vi.C/i 
Q,Si, V 2 , Vi,C7i 
Q,Si, V 2 ,[7 2 , V 1 ,U 1 


£ (1) 

£ ??> 












1 
1 
1 
















1 




2 2 
2 1 
2 1 


Q,S 1 ,Z 1 ,V 1 

Q,S 1 ,Z 1 ,V 2 ,V 1 

Q,S 1 ,Z 1 ,V 2 ,U 2 ,V 1 


£ ?1) 
c 25 

c 26 

Ml 

c 27 

















1 
1 
1 












(1 



1 




2 1 
2° 
2° 


Q,Sy,Z lt V 1 ,U 1 

Q,S 1 ,Z 1 ,V 2 ,V 1 ,U 1 

Q,S 1 ,Z 1 ,V 2 ,U 2 ,V 1 ,U 1 


OK 























2 3 


all correct 



Notice that, given (Q, Si) the input variables for source 1 are not independent of 
the input variables for source 2. 

The possible error events are listed in Table |2j In Table [2] the symbols "1", 
"0" and "★" have the following meaning. A "1" indicates that either the message 
index or the bin index are in error. A "0" indicates that both the message index 
and the bin index are correct. A 'V indicates that it does not matter whether 
the message index is in error; this is so because of superposition coding; in this 
case in fact, the codeword selected by the decoder-even though with the correct 
message index-is superimposed to a wrong codeword and it is thus independent 
of the received signal. In case of a the factorization of the joint probability 
needed for the evaluation of the probability of error is as for the case where the 
message is wrong; this implies that the error event that gives the most stringent 
rate bound is that for which the message is wrong (i.e., as far as error bounds are 
concerned, a 'V is equivalent to a "1"). The second to last column in Table [2] 
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Figure 9: From destination l's perspective, conditioned on Q, decoding is as for a 
3-(virtual)user multiple access channel, where each user sends a superposition of 
codebooks. Here, (virtual)user 1 sends (Vi, Ui, Ti), (virtual)user 2 sends (Si, Z t ), 
and (virtual)user 3 sends (V 2 , U 2 ). 



counts how many error events are included in the corresponding row (i.e., each 
'V corresponds to two possible cases). 

There are several groups of error events in Table 2 : For event £^ : Q is wrong, 
and hence all the decoded codewords are independent of the received signal. For 
events from £^ to S\ is wrong, and thus also Z\ is wrong (because su- 
perimposed to Si). For events from £$ to £%\ . Si is correct but Zi is wrong. 
For events from £32 to £$ : both Si and Z 1 are correct. Notice that, because 
of the way codebooks are superimposed, out of the possible 2 8 — 1 = 255 er- 
ror events, only 28 events matter. A way to understand the error events listed in 
Table [2] is a follows. From destination l's perspective, given Q, there are three 
"super-codebooks" to decode. Conditioned on Q, each "super-codebook" is the 
superposition of one or more codebooks; each "super-codebook" is represented as 
a separate line in Fig. |9j 

Decoding proceeds as for a multiple access channel. In particular, we need 
to consider all possible combinations of events that consist of jointly decoding 
a set of messages from the first column of Fig. [10] and a set of messages from 



the second column of Fig. 10 and a set of messages from the third column of 
Fig. 10 (even though not all combinations are actual errors for destination 1). In 
considering such "joint-decoding events", the messages that do not appear in the 
"set of jointly decoded messages" must be considered as correctly decoded and 
stripped form the received signal, as in a standard multiple access channel. 

The last column in Table[2]is used as follows. Let X be the set of transmitted 
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Ti 

T1 U1 and Z1 and 1,2 

Ti Ui Vi Zi Si U2 V 2 

Figure 10: Destination 1 must consider all possible combinations of events that 
consist of jointly decoding a set of messages from the first column and a set of 
messages from the second column and a set of messages from the third column 
(even though not all combinations are actual errors for destination 1). 



codewords (we do not write here the superscript n that indicates the block-length 
in order to have a lighter notation), and X' be the set of decoded codewords. Let 
C be the subset of the correctly decoded message indices such that X(C) = X'(C) 
(recall that with superposition coding, the decoder might select a codeword X' 
that is different from the transmitted codeword X but with same message index; 
this happens when an error is committed on one of the "base layer" codewords). 
The last column of Table[2]lists the elements of C, i.e., C contains the codewords 
that have a "0" in the corresponding row. The sets C are important for the fac- 
torization of the joint probability needed for the evaluation of the probability of 
error. The error analysis proceeds as follows. The joint distribution of the decoded 
codewords and the received signal is 

-Px(c)x(c c )x'(c c )y 

X(C C ) 

= P X(C)^X(C c )|X(C)^x/ ) ( C c)|x(C) J? V|X(C)X(C c ) 
X(C C ) 

— pW p 



where P is a distribution from the set of possible input distributions in (18) and 
P^ is computed from P as described in the codebook generation paragraph in 
Section that is, 

P QViUiTiSiZ 1 v 2 u 2 = p q p s 1 \qPv 1 u 1 t 1 \qPz 1 \qs 1 v 1 Pv 2 U2\Qi 
where all the factors of P^ are obtained from the corresponding marginalization 
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of P. In the following, we shall drop the prime superscript to distinguished be- 
tween the wrongly decoded codewords and the transmitted codewords. We will 
add a superscript "(g)" to the symbol for entropy to indicate that the entropy must 
be evaluated by using the distribution P^; the symbol for entropy without any 
superscript indicates that the entropy must be evaluated by using the distribution 
P. 

Destination 1 searches for codewords that are joint typicality with the received 
signal according to Pxic^c^Y', however, assuming that the messages in C are 
correctly decoded and those in C c are wrongly decoded (this is the case that gives 
the most stringent error bound), the actual joint distribution is -Px(c=)|x(C)-^ x (C)y- 
The probability of the error for the messages in C c (neglecting the terms that will 
eventually be taken to go to zero) is: 



Pr [error C c 



E 



P X(C C )|X(C) P ^|X(C) 



xeri n) (p x(c)x 



(C)X(C C )Y 



|X(C)) 



< exp I n 



r(c c ) + #(x(c c )|x(c)) + #(y|x(c)x(c c )) 

- #^(X(C C )|X(C)) - H(Y\X(C)) 
exp ( n 



R{C C ) - I(Y A X(C C )|X(C)) + #(X(C C ), X(C)) - H i9) (X(C c ), X(C)) 
-#(X(C)) + #^(X(C))]) 

where R(C C ) is the sum of the rates corresponding to the wrongly decoded mes- 
sages that are indexed by C c . In the following, for any two distributions P and Q, 
the notation E[log(P/Q)] stands for the Kullback-Leibler divergence D(P\\Q). 
Let 



A (i) A #(9)( X (C C ), X(C)) - H(X(C C ), X(C)) = E 



log 



P 



x(c c uc) 



P 



(a) 



x(c c uc) 



E 



log 



log 



QV 1 U 1 T 1 S 1 Z 1 V 2 U 2 



Pq Pvi C/iTi | Q Psi \qPzx\QSi Vi Pv 2 U 2 \Q 
PS! \QV1U1 Ti Pz x \QVtUx T\ gi Py 2 U 2 \QVi Ui T\ gi gi 
Psi \qPzx\QSi Vi Pv 2 U 2 1 Q 



= I(S 1 A VW1T1IQ) + /(Zi A ^TilQ^VO + I(V 2 U 2 A KC/iTiS'iZilQ) 
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Finally, Pr [error C c ] — > as n — > oo if 



R{C C ) < I{Y A X(C C )|X(C)) + A (1) - E 



log 



P 



X(C) 



P 



X(C) 



We now evaluate for all possible error events in Table [2 For Q 
is wrong and hence-because of superposition encoding-the most stringent error 
event is when the messages carried by Q and all the messages superimposed to Q 
are wrong. In this case C = and thus = 0. It can be also easily verified that 



A (D 

{Q} 



A (D 



A (D 

{Q,V2,U 2 } 



A (l) 



for £, 



(l) 



(i) 



for £\ 
A (D 

^{Q,Vi,Ui} 



for £, 



for £ . 



(l) 



for £ 



(i) 



A (l) 



for £, 



(i) 



for £ 



(i) 



for 



63 



because in these cases -Px(C) = P?t(cy Then we have 



'(1) . a(i) 



£> 



£, 



£ 



11 



E 



log 



QV1V2 



Q,Vl,V 2 

/(T4AVo|Q). 

log 

/(V, ' r./ 
(1) ■ , , = 3 log 



p(i) . A (i) _ E 



x Q,VuU u V 2 

= I(V 1 ,U 1 AV 2 \Q) 



p Q p Vl\qPv 2 \q . 



r QViV 2 U 2 

PqPv!\qPv 2 u 2 \q 



^QViUiV 2 

PqPviU±\qPv 2 \q 



(1) . a(1) 



i Q,V 1 ,U 1 ,V 2 ,U 2 



E 



log 



QViUiV 2 U 2 



= I(V 1 ,U 1 AV 2 ,U 2 \Q), 



(1) . A (l) 



E 



log 



QVuUuTuVi 

= I(V 1 ,U 1 ,T 1 AV 2 \Q), 
£ {1) • A {1) - E 



PqPviUi\qPv 2 u 2 \q 



-TQViC/iTiVa 

PqPviU^qPv^q 



log 



QV 1 UiT 1 V 2 U 2 



PqPv 1 u 1 t 1 \qPv 2 u 2 \q . 



c(l) . A (l) 
C 14 • ^Q,Si,V 2 



/(Fi^i.TxA^^ig), 



E 



log 



I(S 1 AV 2 \Q), 



c(l) . A (l) 

c 15 • ^Q,Si,y 2 ,t/2 



E 



p qPs!\qPv 2 \q 
Pc 



log 



-Pq-PsiIqA^^IQ. 



I(S 1 AV 2 ,U 2 \Q), 
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and 



c(i) . A (i) 



E 



log 



PqPs^qPv^q 



= I(S 1 AV 1 \Q), 



: A (1) 



E 



log 



QS'iViy2 



'17 • ti Q,Si,Vi,V r 2 

= /(5 , iAy 1 |g) + /(s , 1 ,y 1 Ay 2 |Q), 



-PQ-PsilQ-PyilQ-PyalQ 



E 



log 



Vi|Q5i-Py 2 |QgiVi 



: A (1) 



E 



log 



'18 • ^Q,S 1 ,V U V2,U 2 

= IiS, A Vi|Q) + I(S 1} V, A \/ 2 , U 2 \Q), 



PqPsi \qPvi \qPv 2 u 2 \q 



and 



cW . A (i) 

c 19 • ^Q,Si,Vi,t7i 



E 



log 



-PQ-PsilQ-FViC/ilQ 



/(^AV^IQ), 



'20 



r(l) 

'21 



a(1) 

^Q,Si,Vi,17i,V2 



E 



log 



P< 



PqPsi \qPvlU! \qPv 2 \q 
IiS, A V,, U,\Q) + I(S 1 , Vi,Ui A V^IQ), 

Pqs x VxU x v 2 u 2 



A^ — F 



log 



-PQ-Psi IQ-fViC/j \qPv 2 u 2 \q 



IiS, A VI, U,\Q) + IiS,, V,,U, A V 2 , C/ 2 |Q), 



and 



(i) 

22 



A (l) 

Q,Si,Z\,V\ 



E 



log 



QSiZiVi 



/(•SxAV^IQ), 



. A (l) 
c 23 • ^Q,Si,Zi,V 2 ,Vi 



E 



^Q-PsilQ-Pvi |Q-Pzi IQSiVi 



E 



log 



Vi\QSi 
P Vi\Q 



log 



Q5iZiViy 2 



^Q-Psi \Q p Vi \qPz! \qsiVi Pv 2 \q . 
IiS,AV,\Q) + IiV 2 AS,,Z,,V,\Q), 

PqSiZ!ViV 2 U 2 



E 



log 



VilQSi^lQSxZiVi 

Pvi\qPv 2 \q 



cW . a(1) 

c 24 • ^q,Si,Zi, y 2 ,c/ 2 ,yi 



E 



log 



-Pq -Psi 1 Q Pvi I Q -Pzi | QSi Vi Py 2 U 2 1 Q 

IiS, A vi|g) + I(V 2 , U 2 A S-x, Zi, V,\Q), 
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and 



c(l) . A CO _ Iff 

C 25 ■ ^Q,5i,Zi,Vi,{/i - ^ 



log 



QSjZiViC/i 



^Q-P5i|Q-fVi[/i|Q-Pzi |QSi Vi 



E 



log 



Vi|Qgi-n7i|QgiViZi 
^VilQ-Pt/ilQVi 



= /(S 1 ! A Vi|Q) + /(f/x A 5 1; ZilQ, Vi), 



'(1) . a(i) 



E 



log 



QS 1 Z 1 ViUiV 2 



P Q P Si |Q-fVif/i|Q -Pzi IQSiVi ^V 2 1 Q 



'26 • ^Q,5i,Zi,V 2 ,Vi,C/i 

= /(S 1 ! A Vi|Q) + 7([/ 1 A S-x, Z,\Q, V 1 ) + 7(F 2 A S ± , V ± , Z u U^Q), 



e. 



(0 . a(1) 



E 



log 



QS 1 Z 1 V 1 UiV 2 U 2 



Pq Psi \qPviUi\q Pz x \QS1V1 Pv 2 U 2 1 Q 



27 • L ^Q,s 1 ,z 1 y 2 ,u 2 y 1 ,u 1 

= I(S 1 A V 1 \Q) + 7([/ 1 A S 1} Z,\Q, V,) + 7(y 2 , U 2 A ft, l^, Z ls U X \Q). 

Let 









= -Rioc + 7?20c 




— PlOo 




= -Rioc + -R' 10c 


#y 2 


— F?' 

~~ -"-200 




= -R 20c + -R 20c 

= -Rio„ + R'lOn 
— Rlln + R'lln 




— R" 

— -"-lie 


-Rsi 


— Rile + P'llc 


P'z! 


= ^llc> 




= Riic + -R' llc 

= -R 2 0n + -R' 20n 

= -R 22n + -R 22n 


R 's 2 


— f?" 

rl 22c' 


Rs 2 


= -R 22c + i? 22c 


R 'z 2 


— £?' 

-"-220 


Rz 2 


= -R 22c + -R' 22c , 



and hence 



R Vl + R Vi = Rq + (R' Vl + R'v 2 ) 
Rz 1 = Rs! - R'sj, + R'z! 

Rz 2 = Rs 2 - Rs 2 + Rz 2 - 

Recall that we defined 

A« = I(S±AVi, U x , T 1 |g)+7(Z 1 AC/ 1 , T,\Q, S 1} Vi)+J(V 2 , U 2 AV U U u T 1} Z 1 \Q, ft). 
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In addition to the rate constraints from cooperation among the sources (see pTj)), 
i.e., 

R Zl < Ci 1] = I(Z X A Y 2 \X 2 , V x ) + I(Z X A S 2 \Q, Si, V!) 
R Vl + R Zl < CP = I(V h Z x A Y 2 \X 2 ) + I(Z X A S 2 \Q, Si, V!) + I{V X A Si, S 2 \Q) 

Rz 2 < c[ 2) = I(Z 2 A Y^X,, V 2 ) + I(Z 2 A Si\Q, S 2 , V 2 ) 
Rv 2 + Rz 2 < = I(V 2 , Z 2 A YilXj + I(Z 2 A Si\Q, S 2 , V 2 ) + I(V 2 A S x , S 2 \Q) 

we have the following rate constraints arising from decoding at destination 1: 

£q ■. Ru 1 + Rt ± + [Rsi + R'z 1 — R'st] + Ru 2 + [Rq + R'vi + R'v 2 \ = 



R Zl 



Rv^ +Rv 2 

Rr^ /// , : /?z, Rr,-\ //r, Ry, < = I(Y 3 A Q, V x , U x , T x , Si, Z x , V 2 , U 2 ) 

+ A« 



~(R' Sl : 



E x : Rq 1 + Rt x + -Rz x + Ru 2 < 

+ A^ 

Z'P '■ Rui + -Rri + Rzi + -Rf/ 2 — E 2 

+ A^ 

£ 3 (1) : + R Tl + R Zl < 

+ A^ 



£(P '■ Rui + Rtx + Rz x 



(i 



£^ : i?^ + + Rz 1 + -Ri/ 2 < E± 

5^ : i^f/i + -Rti + -Rzi + Ru 2 < 

+ A* 1 



(i 



<E L 
+ A^ 



/(F 3 A 7i, U x , T x , S x , Z x , V 2 , U 2 \Q) - (R' Vi + R' Sl + R' V2/ 



I{Y 3 A V x , U x , T x , S x , Z x , U 2 \Q, V 2 ) - (R! Vl + R' Sll 



I(Y 3 A V x , U x , T x , S x , Z X \Q, V 2 , U 2 ) - {R! Vl + R' Sl , 



I(Y 3 A U x , T x , S x , Z x , V 2 , U 2 \Q, V x ) - (R' Sl + R'y 2/ 



-- I(Y 3 A U x , T x , S x , Z x , U 2 \Q, V x , V 2 ) - (R' Si ) 
I(V X AV 2 \Q) 

I(Y 3 A U x , T 1; S x , Z X \Q, V x , V 2 , U 2 ) - (R' Si ) 
I(V X AV 2 ,U 2 \Q) 



67 



4 1} : R Tl + R Zl + Ru 2 < 



: Rt x + Rz! + Ru 2 < E L 
+ A< : 



Sg ■* : Rt x + Rzi 



(i 



(i 



: I(Y 3 A 7\, 5 1; Z u V 2 , U 2 \Q, V u U,) - (R' Sl + R' V J 

■ I(Y 3 A 7\, 5 ls Zx, C/ 2 |Q, 14, t/x, V 2 ) - (i?' 5l ) 
I(V 1 ,U 1 AV 2 \Q) 

■ I(Y 3 A 7\, S u Z ± \Q, V,, U u V 2 , U 2 ) - (R' Si ) 



£w '■ Rzi + Ru 2 < ^io 

: -Rzi + Ru 2 < -En 
+ A (: 



o 12 ■ ti Zl 



< E 



(i 



12 



+ A< : 



: I(Y 3 A S u Z u V 2 , U 2 \Q, V u U u 7i) - (# Sl + i^ 2 ) 

: J(r 3 A S-x, C/ 2 |Q, VI, C/i, Tx, V 2 ) - (R' Sl ) 
I(Vi, U±,Ti A V 2 \Q) 

■ I(Y 3 A Si, Z,\Q, V^U^Ti, V 2 , U 2 ) - (R' Sl ) 
HV^T-lAViMQ) 



£$ : R Vl + R Tl + R U2 < = I(Y 3 A V x , U 1 ,T 1 ,Z 1 , V 2 , U 2 \Q, S,) - (R' Vl + R' Zi + R' V2 ) 



££> : R Vl + R Tl + R U2 < E&> = I(Y 3 A V u U 1 ,T 1 ,Z 1 , U 2 \Q, S 1 , V 2 ) - (R' Vl + R' Zl ) 

+ AW-I(S 1 AV 2 \Q), 
£[l } : R Vl + R Tl < E$ = I(Y 3 A V 1} U u T l7 Z,\Q, S u V 2 , U 2 ) - (R' Vl + R' Zi ) 

+ AW-I(S 1 AV 2 ,U 2 \Q), 



£$ : R Vl + R Tl + Ru 2 < E$> = I(Y 3 AU U T U Z U V 2 , U 2 \Q, S u V 1 ) - (R' Zi + R'y 2 ) 



+ A^-I(S 1 AV 1 \Q), 



£$ : R Vl + R Tl + Ru 2 < E$ = I(Y 3 AU 1 ,T 1 ,Z 1 , U 2 \Q, S 1 ,V 1 , V 2 ) - (R' Zi ) 

+ A« - IiS, A VM - I(S U V 1 A V 2 \Q), 
£$ : R Vl + R Tl < E$ = I(Y 3 A U ± ,T ± , Z ± \Q, S u V u V 2 , U 2 ) - (R' Zi ) 

+ A« - IiS, A V^Q) - I(S 1 , V l A V 2 , U 2 \Q), 
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< Eg = I(Y 3 A T u Z x , V 2 , U 2 \Q, S u V x , Ux) - (R' Zi + R' V2 ) 
+ AW-I(S 1 AV l ,U 1 \Q), 

< Eg = I(Y 3 A T 1} Z x , U 2 \Q, S 1} V, U x , V 2 ) - (R' Zi ) 
+ A (1) - I(S X A V x , U,\Q) - I(S X , V 1} Ux A V 2 \Q), 

< Eg = I(Y 3 A Tx, Z X \Q, S x , V x , U x , V 2 , U 2 ) - (R' Zl ) 
+ A (1) - I(S X A V x , U X \Q) - I(S 1: Vx, U x A V 2 , U 2 \Q), 

I(Y 3 A Ux, Tx, V 2 , U 2 \Q, Sx, Z x , Vx) - (R' V2 ) 
I(S X AV X \Q), 

I(Y 3 AUx,Tx,U 2 \Q,Sx,Zx,Vx,V 2 ) 
I(SxAV x \Q)-I(S x ,Z x ,V x AV 2 \Q), 
I(Y 3 AU X ,T X \Q,S X ,Z X ,V X ,V 2 ,U 2 ) 
I(S X A V X \Q) - I(S X , Z x , V, A V 2 , U 2 \Q), 

£g : R Tl + R U2 < Eg = I{Y 3 A T x , V 2 , U 2 \Q, Sx, Z x , Vx, U x ) - (R' V2 ) 

+ A« - I (Si A V X \Q) - I (Si, Zx A Ui\Q), 
Eg : R Tl + Ru 2 < Eg = I(Y 3 A Tx, U 2 \Q, Sx, Zx, Vx, Ux, V 2 ) 

+ A« - I(S X A V X \Q) - I(S X , Zx A U X \Q) - I(S X , Z x , V, Ux A V 2 \Q), 
Sg : R Tl < Eg = I{Y 3 A Tx\Q, Sx, Z x , V, Ux, V 2 , U 2 ) 

+ A« - I(Sx A Vx\Q) - I(Sx, Zx A Ux\Q) - I(Sx, Zx, V, Ux A V 2 , U 2 \Q). 

All the above constraints combined give the region in ( |22| ). 

Subsets of the above achievable region with fewer rate constraints can be ob- 
tained as follows: 

• If R' Vl = R' V2 = 0, that is, V\ and V 2 are not binned against the known 
interference, then V\ and V 2 are correct whenever Q is correct. In this case, 
16 of the 31 error events listed in Tableware impossible (all those for which 
the bin index in either V\ or V 2 is wrong). 

• If R' Zi = (similar observation can be made if R' Z2 = 0), that is, Zx is 
not binned against the known interference, then Zx is correct whenever Q 



£ 19 : Rt x + Rjj 2 
£g '■ Rti + FL U2 
c 21 . n Tl 



£ 22 '■ Ru x + Rtx + FLu 2 < E 22 — 

+ A«- 

^23 : R-Ui + Rti + FLu 2 < E 23 = 

+ A«- 

£g : Rux + Rtx < Eg = 

+ A«- 
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and V\ are correct. In this case, the 9 error events from £^ to listed in 
Table[2]are impossible and the achievable region becomes 

Ry 1 + Rv2 + RlJi + Rt\ + R1J2 — 

Rui + Rn + Ru 2 < 
Rux + -Rtx < 

i?Ti + Ru 2 < 

Ru 2 < 
^ < 

with only five rate constraints, as for the case of superposition only. Notice 
that the rate bound on R U2 can be removed since an error on U 2 alone is not 
an error from the point of view of source 1. 

• Instead of joint decoding of all the messages, one can perform a two-step 
decoding as follows. First step: decode Q and Si jointly, and then strip 
them from the received signal. This the first decoding step is successful if 

R Sl <I(Y 3 ASM 
R Q + R Sl <I(Y 3 AS 1 ,Q). 

Second step: jointly decode all the other messages. For this second step, 
one only needs to consider the error events from £^ to £$ . 



(32a) 

minl£ (1) E {1) E {1) E {1) E (l) E (l) E {1) E (1) E (1) E (1) \ 

(32b) 

• rp(l) 

(32c) 

„,■ rp(l) P (l)p(l) 

(32d) 

mml^^Sf,^?}, (32e) 
miB^S^ff} (32f) 

(32 g ) 
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